-- Logs begin at Wed 2021-08-04 15:43:51 UTC, end at Wed 2021-08-04 16:47:10 UTC. -- Aug 04 16:15:43.479186 dv-cinder-789564-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 16:15:43.488951 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 4 16:15:43 2021] *** Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: nodename: dv-cinder-789564-9-iscsi Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: machine: x86_64 Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: clock source: unix Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: pcre jit disabled Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: detected number of CPU cores: 4 Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: current working directory: / Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: detected binary path: /usr/bin/uwsgi-core Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: your processes number limit is 47680 Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: your memory page size is 4096 bytes Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: detected max file descriptor number: 2048 Aug 04 16:15:43.490952 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: lock engine: pthread robust mutexes Aug 04 16:15:43.491941 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: thunder lock: enabled Aug 04 16:15:43.491941 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 16:15:43.491941 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 04 16:15:43.535196 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: Python main interpreter initialized at 0x55fae3aa69c0 Aug 04 16:15:43.535196 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: python threads support enabled Aug 04 16:15:43.535196 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: your server socket listen backlog is limited to 100 connections Aug 04 16:15:43.535196 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: your mercy for graceful operations on workers is 90 seconds Aug 04 16:15:43.535615 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 16:15:43.535615 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: *** Operational MODE: preforking *** Aug 04 16:15:43.535933 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: *** uWSGI is running in multiple interpreter mode *** Aug 04 16:15:43.535933 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: spawned uWSGI master process (pid: 92637) Aug 04 16:15:43.536092 dv-cinder-789564-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 16:15:43.537285 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: spawned uWSGI worker 1 (pid: 92638, cores: 1) Aug 04 16:15:43.537285 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: spawned uWSGI worker 2 (pid: 92639, cores: 1) Aug 04 16:15:43.537285 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 16:15:45.164172 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:15:45.164172 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: from cryptography.utils import int_from_bytes Aug 04 16:15:45.164883 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:15:45.164883 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: from cryptography.utils import int_from_bytes Aug 04 16:15:45.167588 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:15:45.167588 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: from cryptography.utils import int_from_bytes Aug 04 16:15:45.168416 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:15:45.168416 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: from cryptography.utils import int_from_bytes Aug 04 16:15:47.894582 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:15:47.895295 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:15:47.895295 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:15:47.895638 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:15:47.895897 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:15:47.896314 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.896626 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.896970 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.897287 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.897623 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.897934 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.898288 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.898610 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.898942 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.899203 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.899508 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.899885 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-789564-9-iscsi {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.900158 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.900462 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.900787 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.901117 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.901626 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.902338 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.902338 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.902814 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.904809 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.904809 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.904809 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.904809 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.904809 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.904809 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.905708 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.905708 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.905708 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.906246 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:15:47.906979 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.907120 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:15:47.907282 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-789564-9-iscsi {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.907533 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:15:47.907718 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.907877 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:15:47.908127 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.908340 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:15:47.908495 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.908725 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.909119 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.909343 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.909469 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.909593 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.909716 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.909832 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.909975 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.910107 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.910235 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.910366 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.910494 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.910625 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.910749 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.910876 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911001 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911115 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911237 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911367 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911492 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911655 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911779 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.911920 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-789564-9-iscsi {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912050 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912175 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912292 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912492 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912614 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912731 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912861 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.912978 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913104 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913221 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913343 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913466 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913595 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913720 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913854 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.913854 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.914117 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.914258 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.914391 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.914518 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.914637 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.914767 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.914887 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915010 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915139 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915262 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915389 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915513 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915637 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915757 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915875 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.915991 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.916116 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.916242 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.916366 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.916488 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.916684 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.917003 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.917313 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.917313 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.917668 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.917840 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-789564-9-iscsi {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.918030 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.918174 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.918306 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.918426 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.918621 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.918806 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.919031 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.919157 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.919278 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.919408 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.919532 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.919662 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.919866 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.920054 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.920186 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.920307 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.920502 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.920691 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.920830 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.920966 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.921086 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.921210 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.921419 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.921613 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.921752 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.921883 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.922059 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.922189 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.922314 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.922445 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.922664 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.922793 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.922985 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.923160 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.923300 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.923441 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.923575 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.923701 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.923830 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.923964 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.924093 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.924219 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.924418 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.924605 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.924736 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.924865 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.925003 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.925130 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.925251 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.925374 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.925491 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.925621 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.925831 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.926037 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.926170 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.926309 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.926440 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.926577 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.926776 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.926961 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.927100 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.927233 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.927360 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.927495 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.927621 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.927742 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.927950 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.928135 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.928273 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.928408 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.928529 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.928647 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.928850 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.929025 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.929153 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.929305 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.929527 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.929671 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.929807 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.929937 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.930099 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.930228 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.930358 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.930563 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.930738 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.930879 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.931003 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.931133 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.931264 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.931394 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.931514 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.931744 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.931938 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.932070 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.932201 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.932322 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.932543 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.932847 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.933060 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.933242 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.933373 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.933495 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.933629 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.933832 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.934082 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.934224 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.934348 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.934474 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.934593 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.934790 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.934983 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.935118 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.935241 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.935371 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.935499 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.935628 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.935753 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.935879 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.936004 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.936228 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.936403 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.936545 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.936677 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.936797 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.936915 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.937125 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.937301 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.937449 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.937573 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.937697 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.937826 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.938016 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.938156 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.938328 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.938457 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.938661 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.938849 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.938988 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.939116 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.939249 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.939369 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.939542 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.939668 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.939846 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.939981 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.940153 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.940289 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.940470 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.940596 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.940797 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.940931 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.941108 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.941234 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.941407 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.941532 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.941714 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.941848 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.942050 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.942181 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.942370 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.942498 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.942680 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.942829 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.943030 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.943154 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.943272 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.943390 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.943600 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.943738 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.943897 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.944030 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.944227 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.944353 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.944534 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.944660 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.944842 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.944967 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.945196 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.945325 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.945525 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.945647 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.945771 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.945900 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.946075 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.946195 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.946360 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.946485 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.946664 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.946788 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.946971 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.947094 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.947277 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.947400 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.947582 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.947712 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.947886 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.948057 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.948363 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.948678 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.948804 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.948996 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.949118 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.949301 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.949423 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.949615 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.949746 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.949941 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.950100 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.950278 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.950419 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.950590 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.950721 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.950898 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.951019 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.951209 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.951344 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:15:47.951518 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.951640 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.951830 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.951954 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.952142 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.952266 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.952467 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.952590 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.952799 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.952930 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.953115 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.953253 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.953453 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.953549 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.953760 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.953854 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.954099 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.954188 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.954414 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.954498 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.954724 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.954819 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.955036 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.955130 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.955346 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.955437 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.955653 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.955750 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.955973 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.956066 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.956284 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.956376 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.956592 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.956685 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.956914 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.957005 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.957220 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.957303 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.957527 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.957622 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.957845 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.958010 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.958179 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.958309 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.958492 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.958628 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.958803 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.958934 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.959128 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.959259 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.959442 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.959565 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.959755 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.959885 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.960081 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.960210 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.960396 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.960526 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.960705 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.960834 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.961023 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.961144 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.961340 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.961472 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.961653 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.961776 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.962001 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.962134 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.962289 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.962414 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.962595 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.962718 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.962903 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.963034 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.963218 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.963323 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.963530 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.963636 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.963865 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.964055 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.964157 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.964469 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.964674 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.964769 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.964989 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.965092 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.965307 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.965409 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.965616 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.965716 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.965943 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.966076 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.966282 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.966373 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.966590 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.966674 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.966923 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.967019 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.967230 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.967320 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.967543 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.967627 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.967857 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.968343 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.968519 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.968605 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.968834 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.968919 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.969144 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.969243 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.969451 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.969542 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.969762 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.969901 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.970103 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.970233 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.970412 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.970536 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.970726 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.970849 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.971032 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.971154 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.971336 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.971465 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.971650 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.971782 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.971961 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.972084 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.972274 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.972399 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.972587 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.972733 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.972897 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.973025 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.973212 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.973349 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.973539 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.973669 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.973827 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.973990 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.974166 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.974302 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.974476 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.974609 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.974784 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.974911 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.975098 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.975222 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.975413 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.975543 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.975719 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.975849 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.976031 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.976155 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.976336 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.976459 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.976641 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.976762 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.976947 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.977079 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.977254 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.977377 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.977557 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.977678 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.977864 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.978026 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.978197 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.978321 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.978505 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.978627 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.978810 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.978932 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.979133 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.979302 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.979488 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.979798 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.980022 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.980153 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.980350 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.980483 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.980665 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.980788 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.980977 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.981109 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.981302 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.981423 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.981621 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.981743 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.981962 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.982099 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.982274 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.982397 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.982597 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.982720 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.982921 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.983051 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.983238 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.983358 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.983586 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.983718 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.983859 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.983991 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.984168 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.984301 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.984491 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.984612 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.984799 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.984931 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.985109 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.985231 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.985416 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.985537 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.985727 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.985850 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.986061 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.986185 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.986378 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.986502 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.986694 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.986817 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.987005 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.987134 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.987320 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.987442 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.987632 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.987754 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.987935 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.988066 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.988243 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.988365 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.988551 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.988675 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.988857 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.989145 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.989269 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.989473 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.989596 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.989785 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.989907 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.990124 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.990248 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.990431 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.990561 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.990750 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.990872 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.991063 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.991185 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.991371 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.991494 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.991677 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.991807 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.991991 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.992120 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.992313 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.992431 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.992620 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.992743 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.992930 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.993051 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.993249 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.993373 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.993551 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.993686 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.993878 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.994032 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.994178 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.994298 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.994489 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.994610 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.994794 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.994950 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.995311 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.995645 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.995796 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.996116 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.996238 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.996468 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.996719 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.996851 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.997088 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.997287 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.997412 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.997727 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.997889 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.998094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.998216 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.998375 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.998484 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.998693 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.998818 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.999007 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.999138 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.999331 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.999537 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.999659 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.999777 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:47.999946 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.000072 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.000263 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.000394 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.000576 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.000684 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.000893 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.001085 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.001195 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.001352 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.001511 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.001633 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.001822 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.001967 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.002162 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.002300 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.002526 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.002655 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.002837 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.003150 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.003294 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.003459 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.003717 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.003861 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.004058 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.004287 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.004495 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.004678 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.004993 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.005309 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.005432 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.005617 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.005932 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.006147 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.006270 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.006546 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.006670 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.006872 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.007153 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.007284 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.007472 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.007756 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.007880 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.008085 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.008345 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.008477 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.008688 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.008960 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.009082 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.009302 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.009580 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.009714 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.009904 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.010211 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.010336 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.010568 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.010853 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.010984 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.011203 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.011449 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.011572 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.011834 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.012024 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.012148 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.012442 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.012601 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.012732 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.013048 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.013181 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.013360 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.013686 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.013808 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.014111 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.014345 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.014482 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.014658 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.014936 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.015058 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.015262 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.015513 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.015645 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.015869 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.016085 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.016207 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.016470 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.016671 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.016794 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.017068 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.017244 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.017367 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.017683 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.017814 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.018014 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.018327 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.018449 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.018636 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.018943 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.019077 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.019288 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.019470 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.019592 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.019804 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.019941 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.020237 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.020360 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.020556 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.020739 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.020880 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.021064 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.021197 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.021391 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.021511 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.021708 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.021830 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.022092 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.022183 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.022416 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.022501 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.022775 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.022861 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.023094 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.023179 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.023399 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.023482 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.023706 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.023789 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.024029 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.024114 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.024345 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.024438 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.024655 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.024745 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.024976 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.025060 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.025288 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.025371 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.025605 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.025698 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.025908 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.026018 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.026314 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.026423 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.026628 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.026941 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.027147 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.027236 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.027482 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.027594 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.027808 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.027894 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.028132 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.028219 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.028447 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.028530 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.028759 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.028852 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.029069 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.029154 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.029378 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.029488 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.029691 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.029775 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.030026 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.030115 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.030334 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.030417 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.030650 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.030741 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.030959 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.031053 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.031265 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.031349 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.031578 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.031679 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.031884 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.032081 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.032196 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.032503 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.032587 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.032975 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.033099 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.033300 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.033616 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.033710 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.033925 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.034133 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.034268 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.034585 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.034687 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.034904 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.035178 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.035275 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.035526 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.035713 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.036045 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.036269 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.036361 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.036585 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.036864 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.036955 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.037194 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.037419 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.037513 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.037803 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.037888 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.038157 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.038253 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.038463 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.038556 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.038774 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.038859 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.039082 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.039166 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.039410 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.039502 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.039722 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.039807 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.040045 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.040142 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.040386 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.040478 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.040705 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.040798 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.041018 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.041102 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.041336 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.041492 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.041635 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.041856 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.042196 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.042556 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.042662 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.042891 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.042971 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.043217 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.043308 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.043537 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.043630 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.043859 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.043948 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.044176 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.044258 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.044570 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.044679 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.044807 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.044900 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.045118 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.045203 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.045436 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.045529 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.045749 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.045833 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.046103 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.046304 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.046432 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.046526 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.046751 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.046844 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.047076 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.047167 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.047399 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.047484 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.047719 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.047803 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.048042 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.048126 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.048357 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.048442 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.048679 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.048762 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.049001 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.049085 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.049321 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.049406 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.049635 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.049717 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.049941 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.050061 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.050274 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.050359 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.050592 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.050674 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.050899 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.051034 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.051219 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.051301 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.051534 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.051617 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.051849 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.051944 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.052157 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.052240 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.052463 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.052546 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.052785 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.052888 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.053094 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.053183 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.053409 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.053490 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.053722 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.053816 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.054061 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.054147 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.054382 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.054467 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.054692 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.054794 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.055002 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.055092 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.055314 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.055396 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.055625 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.055709 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.055932 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.056014 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.056242 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.056332 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.056547 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.056639 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.056878 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.056961 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.057191 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.057273 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.057525 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.057672 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.058111 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.058396 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.058479 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.058723 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.058824 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.059051 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.059146 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.059369 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.059462 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.059700 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.059840 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.060034 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.060161 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.060345 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.060482 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.060655 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.060796 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.060968 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.061115 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.061277 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.061435 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.061586 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.061760 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.061894 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.062107 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.062314 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.062420 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.062622 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.062856 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.062941 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.063178 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.063262 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.063500 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.063585 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.063818 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.063902 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.064129 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.064212 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.064439 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.064523 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.064752 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.064879 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.065064 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.065202 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.065372 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.065496 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.065679 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.065801 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.066009 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.066137 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.066338 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.066463 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.066649 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.066780 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.066985 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.067116 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.067312 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.067442 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.067627 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.067750 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.067954 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.068086 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.068275 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.068401 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.068596 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.068719 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.068916 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.069040 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.069234 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.069367 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.069555 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.069693 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.069873 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.070010 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.070217 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.070431 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.070553 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.070672 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.070840 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.070956 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.071159 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.071296 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.071480 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.071604 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.071811 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.072059 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.072183 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.072390 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.072516 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.072716 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.072839 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.073099 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.073253 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.073456 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.073782 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.074008 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.074137 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.074343 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.074479 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.074735 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.075017 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.075150 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.075272 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.075390 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.075523 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.075676 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.075799 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.076010 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.076133 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.076347 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.076478 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.076661 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.076777 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.076978 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.077101 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.077293 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.077425 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.077608 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.077732 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.077926 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.078067 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.078261 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.078390 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.078580 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.078703 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.078899 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.079021 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.079213 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.079337 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.079524 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.079654 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.079834 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.079966 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.080155 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.080342 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.080489 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.080635 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.080766 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.080896 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.081078 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.081202 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.081405 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.081529 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.081716 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.081853 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.082049 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.082184 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.082366 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.082495 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.082681 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.082815 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.082993 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.083124 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.083303 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.083426 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.083611 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.083737 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.083952 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.084075 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.084261 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.084381 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.084587 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.084792 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.084914 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.085115 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.085258 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.085450 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.085583 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.085778 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.085901 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.086132 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.086268 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.086457 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.086580 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.086780 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.086895 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.087112 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.087236 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.087424 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.087548 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.087732 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.087855 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.088049 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.088173 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.088362 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.088484 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.088704 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.088835 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.089033 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.089349 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.089534 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.089657 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.089860 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.090001 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.090210 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.090334 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.090526 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.090815 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.090939 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.091191 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.091326 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.091456 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.091577 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.091771 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.091901 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.092087 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.092210 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.092399 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.092523 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.092712 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.092834 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.093371 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.093497 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.093681 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.093812 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.094010 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.094131 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.094331 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.094455 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.094646 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.094772 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.094955 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.095077 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.095265 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.095390 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.095580 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.095705 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.095893 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.095988 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.096202 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.096362 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.096507 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.096643 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.096805 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.096958 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.097139 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.097301 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.097436 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.097619 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.097754 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.097887 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.098068 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.098221 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.098386 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.098536 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.098699 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.098840 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.099009 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.099159 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.099312 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.099447 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.099614 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.099882 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.100032 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.100218 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.100358 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.100528 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.100666 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.100836 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.101070 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.101257 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.101397 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.101542 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.101676 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.101818 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.101998 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.102150 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.102285 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.102419 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.102552 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.102685 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.102827 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.102963 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.103095 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.103260 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.103420 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.103565 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.103699 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.103891 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.104032 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.104209 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.104442 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.104798 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.105158 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.105301 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.105570 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.105769 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.105935 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.106128 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.106304 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.106491 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.106686 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.106872 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.107070 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.107212 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.107346 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.107479 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.107620 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.107770 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.107925 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.108061 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.108198 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.108353 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.108494 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.108680 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.108830 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.109013 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.109155 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.109339 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.109480 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.109657 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.109798 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.110002 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.110146 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.110303 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.110444 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.110621 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.110770 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.110956 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.111097 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.111282 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.111421 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.111601 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.111745 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.111916 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.112054 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.112234 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.112375 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.112556 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.112697 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.112890 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.113086 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.113227 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.113406 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.113547 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.113743 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.113884 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.114107 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.114248 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.114437 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.114579 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.114762 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.114904 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.115081 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.115221 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.115411 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.115566 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.115783 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.115923 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.116068 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.116215 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.116350 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.116484 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.116617 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.116749 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.116919 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.117074 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.117245 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.117387 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.117560 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.117702 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.117872 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.118079 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.118219 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.118360 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.118505 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.118663 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.118995 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.119161 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.119298 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.119431 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.119609 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.119750 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.119944 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.120261 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.120608 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.120749 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.120949 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.121089 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.121276 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.121419 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.121608 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.121750 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.121925 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.122124 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.122282 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.122380 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.122595 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.122702 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.122944 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.123075 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.123230 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.123326 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.123572 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.123703 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.123891 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.124020 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.124200 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.124329 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.124514 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.124658 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.124828 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.124977 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.125142 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.125303 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.125430 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.125534 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.125771 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.125914 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.126081 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.126176 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.126419 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.126563 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.126728 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.126870 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.127029 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.127119 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.127341 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.127439 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.127646 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.127751 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.127959 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.128048 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.128269 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.128357 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.128587 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.128683 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.128892 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.128980 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.129207 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.129337 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.129531 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.129706 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.129845 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.130009 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.130151 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.130284 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.130430 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.130565 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.130736 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.130877 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.131058 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.131200 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.131432 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.131575 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.131735 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.131871 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.132012 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.132153 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.132296 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.132431 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.132564 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.132708 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.132886 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.133035 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.133204 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.133369 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.133555 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.133695 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.133872 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.134046 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.134226 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.134547 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.134693 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.134865 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.135007 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.135199 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.135341 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.135586 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.135930 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.136244 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.136589 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.136734 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.136952 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.137049 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.137278 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.137366 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.137602 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.137694 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.137917 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.138024 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.138269 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.138367 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.138604 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.138700 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.138922 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.139011 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.139238 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.139334 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.139560 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.139648 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.139876 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.139972 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.140182 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:15:48.140278 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.140499 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.140813 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.141127 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.141426 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.141777 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.142127 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.142452 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.142775 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.143096 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.143417 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.143735 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.144052 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.144382 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.144750 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.145036 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.145354 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.145666 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.146131 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.146450 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.146774 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.147102 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.147417 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.147748 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.148094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.148430 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.148759 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.149072 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.149384 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.149697 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.150037 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.150384 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.150724 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.151045 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.151894 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.152223 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.152549 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.152868 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.153187 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.153510 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.153829 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.154183 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.154508 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.154831 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.155146 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.155474 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.155790 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.156149 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.156412 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.156731 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.157043 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.157375 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.157718 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.158065 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.158613 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.158768 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.159151 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.159488 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.159641 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162094 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162720 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.162720 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.163025 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.163388 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.163699 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.163908 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_db.sqlalchemy.engines [None req-ce882ef6-cf73-403f-b515-801829269594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.164054 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.164333 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.164659 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.164960 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.165276 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.165606 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.165918 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.166265 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.166574 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.167235 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.167566 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.167876 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.168207 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.168538 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.168877 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.169206 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.169581 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.169896 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.170262 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.170591 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:15:48.170840 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:15:48.194718 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.244945 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.context [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9260958d-5d7e-4ff1-bc72-6315537cc5be(cell1) {{(pid=92638) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:15:48.249223 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_concurrency.lockutils [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:15:48.250885 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_concurrency.lockutils [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:15:48.251706 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_concurrency.lockutils [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:15:48.253684 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_concurrency.lockutils [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:15:48.264530 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_db.sqlalchemy.engines [None req-ce882ef6-cf73-403f-b515-801829269594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.267143 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_db.sqlalchemy.engines [None req-ce882ef6-cf73-403f-b515-801829269594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.279108 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.context [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9260958d-5d7e-4ff1-bc72-6315537cc5be(cell1) {{(pid=92639) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:15:48.283391 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:15:48.285015 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:15:48.285831 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:15:48.287827 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:15:48.300772 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.303274 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.641181 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG oslo_db.sqlalchemy.engines [None req-ce882ef6-cf73-403f-b515-801829269594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.692757 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:15:48.990484 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: WARNING keystonemiddleware.auth_token [None req-ce882ef6-cf73-403f-b515-801829269594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:15:48.997072 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: WARNING keystonemiddleware.auth_token [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:15:49.023228 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: WARNING keystonemiddleware.auth_token [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:15:49.030461 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: WARNING keystonemiddleware.auth_token [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:15:49.347066 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: WARNING keystonemiddleware.auth_token [None req-ce882ef6-cf73-403f-b515-801829269594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:15:49.352555 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: WARNING keystonemiddleware.auth_token [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:15:49.358364 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fae3aa69c0 pid: 92638 (default app) Aug 04 16:15:49.360686 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:15:49.361985 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-ce882ef6-cf73-403f-b515-801829269594 None None] 10.222.0.77 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001942 Aug 04 16:15:49.362410 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 789 bytes} [Wed Aug 4 16:15:49 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:15:49.391708 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: WARNING keystonemiddleware.auth_token [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:15:49.396927 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: WARNING keystonemiddleware.auth_token [None req-fdf1b448-061f-4226-ae86-47d4cdfb429c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:15:49.403210 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fae3aa69c0 pid: 92639 (default app) Aug 04 16:17:12.328369 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:12.329391 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-ce882ef6-cf73-403f-b515-801829269594 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 04 16:17:12.329938 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:12.773539 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-82cc49dd-4675-4f4c-867b-ab0ccdaadfb8 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:12.803207 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-82cc49dd-4675-4f4c-867b-ab0ccdaadfb8 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.466025 Aug 04 16:17:12.803924 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 1/3] 10.222.0.77 () {60 vars in 1292 bytes} [Wed Aug 4 16:17:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:15.015721 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-ce882ef6-cf73-403f-b515-801829269594 None None] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:15.016779 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-ce882ef6-cf73-403f-b515-801829269594 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 04 16:17:15.017470 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 3/4] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:15.095668 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-3d1f4c3e-bea6-4823-860e-a2ca39b7e3d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "vcpus": 1, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:15.115110 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:17:15.115110 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: warnings.warn(msg) Aug 04 16:17:15.146522 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-3d1f4c3e-bea6-4823-860e-a2ca39b7e3d5 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.120177 Aug 04 16:17:15.147652 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 2/5] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:15 2021] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:17:15.384038 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-85355af0-0ef6-40af-8954-3a35e16e9c7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:15.386326 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:17:15.386326 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: warnings.warn(msg) Aug 04 16:17:15.443965 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-85355af0-0ef6-40af-8954-3a35e16e9c7f admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283623 Aug 04 16:17:15.444759 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 4/6] 10.222.0.77 () {64 vars in 1336 bytes} [Wed Aug 4 16:17:15 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:17.667092 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-3d1f4c3e-bea6-4823-860e-a2ca39b7e3d5 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:17.668105 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-3d1f4c3e-bea6-4823-860e-a2ca39b7e3d5 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 04 16:17:17.668914 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 3/7] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:17.775080 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-a91b5104-0d5a-475d-b4f8-1c94684883e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:17.792648 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:17:17.792648 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: warnings.warn(msg) Aug 04 16:17:17.812650 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-a91b5104-0d5a-475d-b4f8-1c94684883e6 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135803 Aug 04 16:17:17.813207 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 5/8] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:17:17.825564 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-34950291-67e2-4c8f-8ba1-cf835d57350e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:17.827150 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:17:17.827150 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: warnings.warn(msg) Aug 04 16:17:17.861003 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-34950291-67e2-4c8f-8ba1-cf835d57350e admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039127 Aug 04 16:17:17.861630 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 4/9] 10.222.0.77 () {64 vars in 1336 bytes} [Wed Aug 4 16:17:17 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:17:20.327172 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-a91b5104-0d5a-475d-b4f8-1c94684883e6 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:20.328192 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-a91b5104-0d5a-475d-b4f8-1c94684883e6 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 04 16:17:20.329056 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:20.393727 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-c67929b8-6fb3-4bc2-b297-f8d8a15039ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G"}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:20.415879 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-c67929b8-6fb3-4bc2-b297-f8d8a15039ab admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079289 Aug 04 16:17:20.416598 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 5/11] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:17:20.428533 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-ade04bd8-faa3-427d-aee9-8394d0e8d648 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:20.454066 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-ade04bd8-faa3-427d-aee9-8394d0e8d648 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029144 Aug 04 16:17:20.454649 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 7/12] 10.222.0.77 () {64 vars in 1336 bytes} [Wed Aug 4 16:17:20 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:17:22.662837 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-c67929b8-6fb3-4bc2-b297-f8d8a15039ab admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:22.663868 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-c67929b8-6fb3-4bc2-b297-f8d8a15039ab admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Aug 04 16:17:22.664549 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 6/13] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:22.732271 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-608e1578-0851-4863-8c95-5296927d48ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:22.753591 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-608e1578-0851-4863-8c95-5296927d48ac admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081841 Aug 04 16:17:22.754280 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 8/14] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:17:22.768890 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-ee7cc6f9-2ce4-4322-838f-1a35b2ea6dab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:22.793297 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-ee7cc6f9-2ce4-4322-838f-1a35b2ea6dab admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028553 Aug 04 16:17:22.794014 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 7/15] 10.222.0.77 () {64 vars in 1336 bytes} [Wed Aug 4 16:17:22 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:25.035104 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-608e1578-0851-4863-8c95-5296927d48ac admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:25.036031 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-608e1578-0851-4863-8c95-5296927d48ac admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 04 16:17:25.036407 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 9/16] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:25.097883 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-43ba757d-4440-4d19-a473-c0e9d1ce803c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:25.118954 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-43ba757d-4440-4d19-a473-c0e9d1ce803c admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074413 Aug 04 16:17:25.119890 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 8/17] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:17:25.131816 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-f229d388-d8cb-42d3-9f5d-ba2fe07b43f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:25.160792 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-f229d388-d8cb-42d3-9f5d-ba2fe07b43f2 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032650 Aug 04 16:17:25.161690 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 10/18] 10.222.0.77 () {64 vars in 1336 bytes} [Wed Aug 4 16:17:25 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:27.400601 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-43ba757d-4440-4d19-a473-c0e9d1ce803c admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:27.402277 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-43ba757d-4440-4d19-a473-c0e9d1ce803c admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002420 Aug 04 16:17:27.402678 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 9/19] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:27 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:17:27.504104 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-0024a617-53aa-4783-9658-29d589031833 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:27.529226 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-0024a617-53aa-4783-9658-29d589031833 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.117080 Aug 04 16:17:27.530242 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 11/20] 10.222.0.77 () {60 vars in 1292 bytes} [Wed Aug 4 16:17:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:17:29.877240 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-43ba757d-4440-4d19-a473-c0e9d1ce803c admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:29.878523 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-43ba757d-4440-4d19-a473-c0e9d1ce803c admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Aug 04 16:17:29.879221 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 10/21] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:29.977447 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-fe5efbfd-0c6d-40eb-9a3a-89a182f351af admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "rxtx_factor": 1.0}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:29.999908 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-fe5efbfd-0c6d-40eb-9a3a-89a182f351af admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.105531 Aug 04 16:17:30.000539 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 12/22] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:29 2021] POST /compute/v2.1/flavors => generated 402 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:17:30.014764 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-dd340c99-668f-4065-9c53-bcf9da093cd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:30.040583 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-dd340c99-668f-4065-9c53-bcf9da093cd8 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029553 Aug 04 16:17:30.041088 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 11/23] 10.222.0.77 () {64 vars in 1333 bytes} [Wed Aug 4 16:17:30 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:32.428903 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-fe5efbfd-0c6d-40eb-9a3a-89a182f351af admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:32.430349 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-fe5efbfd-0c6d-40eb-9a3a-89a182f351af admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001863 Aug 04 16:17:32.430828 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:32.520698 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-56229734-c874-4e1b-b590-9a0f1e3ba9db admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "2", "ram": 2048}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:32.545335 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-56229734-c874-4e1b-b590-9a0f1e3ba9db admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.105256 Aug 04 16:17:32.545979 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 12/25] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:32 2021] POST /compute/v2.1/flavors => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:17:32.562273 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-da7e9500-d0af-4c5c-87df-4323c572deb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:32.592657 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-da7e9500-d0af-4c5c-87df-4323c572deb4 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034310 Aug 04 16:17:32.593337 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 14/26] 10.222.0.77 () {64 vars in 1333 bytes} [Wed Aug 4 16:17:32 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:35.004612 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-56229734-c874-4e1b-b590-9a0f1e3ba9db admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:35.005646 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-56229734-c874-4e1b-b590-9a0f1e3ba9db admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 04 16:17:35.006079 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 13/27] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:35.065992 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-4900bc48-f77f-410c-a8ff-13b8a4ac3674 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "ram": 4096}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:35.085566 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-4900bc48-f77f-410c-a8ff-13b8a4ac3674 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072674 Aug 04 16:17:35.086226 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 15/28] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:35 2021] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:17:35.098771 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-9cc82cef-e953-4669-8234-169dd2d6ffe2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:35.123131 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-9cc82cef-e953-4669-8234-169dd2d6ffe2 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028048 Aug 04 16:17:35.123916 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 14/29] 10.222.0.77 () {64 vars in 1333 bytes} [Wed Aug 4 16:17:35 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:37.331523 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-4900bc48-f77f-410c-a8ff-13b8a4ac3674 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:37.332617 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-4900bc48-f77f-410c-a8ff-13b8a4ac3674 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001944 Aug 04 16:17:37.333233 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 16/30] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:37.395527 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-3880061f-16b5-42da-9fb0-74df09d01ff4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:37.422495 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-3880061f-16b5-42da-9fb0-74df09d01ff4 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080934 Aug 04 16:17:37.430501 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 15/31] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:37 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:17:37.435622 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-a7dcb4ff-8cfd-41f1-abe2-c336c4365c34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:37.460717 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-a7dcb4ff-8cfd-41f1-abe2-c336c4365c34 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028744 Aug 04 16:17:37.461333 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 17/32] 10.222.0.77 () {64 vars in 1333 bytes} [Wed Aug 4 16:17:37 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:17:39.718814 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-3880061f-16b5-42da-9fb0-74df09d01ff4 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:17:39.720477 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-3880061f-16b5-42da-9fb0-74df09d01ff4 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Aug 04 16:17:39.720868 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 16/33] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:17:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:17:39.779276 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-8fbae892-4fe0-41f2-99d9-333bedc27b96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:39.799355 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-8fbae892-4fe0-41f2-99d9-333bedc27b96 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071353 Aug 04 16:17:39.799902 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 18/34] 10.222.0.77 () {64 vars in 1283 bytes} [Wed Aug 4 16:17:39 2021] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:17:39.812212 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-e2c5480c-4761-4346-8e6d-ec948341ae22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:17:39.838383 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-e2c5480c-4761-4346-8e6d-ec948341ae22 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029723 Aug 04 16:17:39.839881 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 17/35] 10.222.0.77 () {64 vars in 1333 bytes} [Wed Aug 4 16:17:39 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:18:20.465936 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-8fbae892-4fe0-41f2-99d9-333bedc27b96 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:20.467058 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-8fbae892-4fe0-41f2-99d9-333bedc27b96 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Aug 04 16:18:20.467511 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 19/36] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:18:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:20.525980 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-aed29185-9c07-4a7e-8df5-964aac7defb0 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:20.544376 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-aed29185-9c07-4a7e-8df5-964aac7defb0 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069589 Aug 04 16:18:20.544929 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 18/37] 10.222.0.77 () {60 vars in 1292 bytes} [Wed Aug 4 16:18:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:18:22.197168 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-8fbae892-4fe0-41f2-99d9-333bedc27b96 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:22.198208 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-8fbae892-4fe0-41f2-99d9-333bedc27b96 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 04 16:18:22.198603 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 20/38] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:22.415143 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-d650dc82-506b-4a02-80de-82e048ddc23b admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:22.421648 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.wsgi [None req-d650dc82-506b-4a02-80de-82e048ddc23b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 16:18:22.422421 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-d650dc82-506b-4a02-80de-82e048ddc23b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:18:22.423732 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-d650dc82-506b-4a02-80de-82e048ddc23b admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.087990 Aug 04 16:18:22.424411 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 19/39] 10.222.0.77 () {60 vars in 1191 bytes} [Wed Aug 4 16:18:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:18:22.437880 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-31efadd1-3661-49cf-b121-5000e8b72c64 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:22.474583 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-31efadd1-3661-49cf-b121-5000e8b72c64 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.042358 Aug 04 16:18:22.475449 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 21/40] 10.222.0.77 () {60 vars in 1211 bytes} [Wed Aug 4 16:18:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:18:22.486425 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-08181ad8-dd57-4a08-b993-89c2f520b240 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:22.507387 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-08181ad8-dd57-4a08-b993-89c2f520b240 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024703 Aug 04 16:18:22.507959 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 20/41] 10.222.0.77 () {60 vars in 1211 bytes} [Wed Aug 4 16:18:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:18:22.518357 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-fd5c1060-4d02-41d2-9917-7a41f31a2d7a admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:22.524051 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.wsgi [None req-fd5c1060-4d02-41d2-9917-7a41f31a2d7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 16:18:22.524667 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-fd5c1060-4d02-41d2-9917-7a41f31a2d7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:18:22.525435 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-fd5c1060-4d02-41d2-9917-7a41f31a2d7a admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010936 Aug 04 16:18:22.525979 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 22/42] 10.222.0.77 () {60 vars in 1191 bytes} [Wed Aug 4 16:18:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:18:23.940127 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-08181ad8-dd57-4a08-b993-89c2f520b240 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:23.941168 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-08181ad8-dd57-4a08-b993-89c2f520b240 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 04 16:18:23.941585 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 21/43] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:24.134428 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-894e56d7-eb59-4fcf-9ea4-8d29b966fe8b admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:24.139881 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.wsgi [None req-894e56d7-eb59-4fcf-9ea4-8d29b966fe8b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 16:18:24.140424 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-894e56d7-eb59-4fcf-9ea4-8d29b966fe8b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:18:24.141230 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-894e56d7-eb59-4fcf-9ea4-8d29b966fe8b admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.058056 Aug 04 16:18:24.142135 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 23/44] 10.222.0.77 () {60 vars in 1191 bytes} [Wed Aug 4 16:18:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:18:24.152035 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-1af42e16-7018-48cf-92b0-6c1cf1af4cbd admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:24.165880 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-1af42e16-7018-48cf-92b0-6c1cf1af4cbd admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017493 Aug 04 16:18:24.166468 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 22/45] 10.222.0.77 () {60 vars in 1211 bytes} [Wed Aug 4 16:18:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:18:24.177314 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-28dba95e-8ba8-488d-8f9b-9be63648d39c admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:24.191636 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-28dba95e-8ba8-488d-8f9b-9be63648d39c admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018027 Aug 04 16:18:24.192234 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 24/46] 10.222.0.77 () {60 vars in 1211 bytes} [Wed Aug 4 16:18:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:18:24.202735 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-5dbd7e53-299c-46fd-b9c8-46d0b4137247 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:24.208549 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.wsgi [None req-5dbd7e53-299c-46fd-b9c8-46d0b4137247 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 16:18:24.209110 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-5dbd7e53-299c-46fd-b9c8-46d0b4137247 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:18:24.209898 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-5dbd7e53-299c-46fd-b9c8-46d0b4137247 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010896 Aug 04 16:18:24.210429 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 23/47] 10.222.0.77 () {60 vars in 1191 bytes} [Wed Aug 4 16:18:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:18:25.577982 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-28dba95e-8ba8-488d-8f9b-9be63648d39c admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:25.579196 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-28dba95e-8ba8-488d-8f9b-9be63648d39c admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 04 16:18:25.579590 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 25/48] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:25.789991 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-330b910b-1bc1-4ecf-842c-e8ea4a7e77d1 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:25.795842 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.wsgi [None req-330b910b-1bc1-4ecf-842c-e8ea4a7e77d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 16:18:25.796412 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-330b910b-1bc1-4ecf-842c-e8ea4a7e77d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:18:25.797207 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-330b910b-1bc1-4ecf-842c-e8ea4a7e77d1 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.069495 Aug 04 16:18:25.797802 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 24/49] 10.222.0.77 () {60 vars in 1194 bytes} [Wed Aug 4 16:18:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:18:25.807885 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-238f7d8c-41c9-4b53-b881-2b14f43db61b admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:25.822002 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-238f7d8c-41c9-4b53-b881-2b14f43db61b admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017616 Aug 04 16:18:25.822572 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 26/50] 10.222.0.77 () {60 vars in 1211 bytes} [Wed Aug 4 16:18:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:18:25.833010 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:25.847162 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017727 Aug 04 16:18:25.847716 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 25/51] 10.222.0.77 () {60 vars in 1211 bytes} [Wed Aug 4 16:18:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:18:25.857741 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-52f8d43d-2374-49f8-868d-a3616b55cb43 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:25.863358 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.wsgi [None req-52f8d43d-2374-49f8-868d-a3616b55cb43 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 16:18:25.863935 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-52f8d43d-2374-49f8-868d-a3616b55cb43 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:18:25.864802 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-52f8d43d-2374-49f8-868d-a3616b55cb43 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010644 Aug 04 16:18:25.865253 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 27/52] 10.222.0.77 () {60 vars in 1194 bytes} [Wed Aug 4 16:18:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:18:27.261183 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:27.262244 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 04 16:18:27.262612 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 26/53] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:27.456841 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-78de7017-6ef4-4fea-9693-b44dddbb10b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:18:27.479165 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-78de7017-6ef4-4fea-9693-b44dddbb10b2 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.077916 Aug 04 16:18:27.479647 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 28/54] 10.222.0.77 () {64 vars in 1236 bytes} [Wed Aug 4 16:18:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:18:28.842967 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:28.843978 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 04 16:18:28.844376 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 27/55] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:29.044841 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-c3937497-a8d8-45b7-8c71-47a138d0f444 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:18:29.070477 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-c3937497-a8d8-45b7-8c71-47a138d0f444 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.085567 Aug 04 16:18:29.071205 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 29/56] 10.222.0.77 () {64 vars in 1236 bytes} [Wed Aug 4 16:18:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:18:30.453208 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:30.454369 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 04 16:18:30.454759 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 28/57] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:30.655009 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-0ecb16c6-6cf1-42ca-8d29-2e3c35cf64b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:18:30.676211 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-0ecb16c6-6cf1-42ca-8d29-2e3c35cf64b9 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.080441 Aug 04 16:18:30.676791 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 30/58] 10.222.0.77 () {64 vars in 1236 bytes} [Wed Aug 4 16:18:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:18:32.035622 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:32.036634 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 04 16:18:32.037034 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 29/59] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:32.236187 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-89ae1ee9-719f-4d43-be13-de1b1d918388 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:18:32.259016 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-89ae1ee9-719f-4d43-be13-de1b1d918388 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.082837 Aug 04 16:18:32.259495 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 31/60] 10.222.0.77 () {64 vars in 1236 bytes} [Wed Aug 4 16:18:32 2021] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:18:33.674931 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:33.675939 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 04 16:18:33.676398 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 30/61] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:18:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:18:33.882313 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-47427166-7f7f-4bd4-9b02-a10e71db39a6 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:18:33.902947 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-47427166-7f7f-4bd4-9b02-a10e71db39a6 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.086588 Aug 04 16:18:33.903487 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 32/62] 10.222.0.77 () {60 vars in 1203 bytes} [Wed Aug 4 16:18:33 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:19:21.513211 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:19:21.514405 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87a649d6-3f07-4b0a-b03f-36032d6ee3de admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 Aug 04 16:19:21.514905 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 31/63] 10.222.0.77 () {54 vars in 931 bytes} [Wed Aug 4 16:19:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:19:21.581474 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-ff565bb3-61dc-4b52-ae74-141b6bc2569b admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:19:21.601928 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-ff565bb3-61dc-4b52-ae74-141b6bc2569b admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078750 Aug 04 16:19:21.602809 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 33/64] 10.222.0.77 () {60 vars in 1292 bytes} [Wed Aug 4 16:19:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:19:21.629598 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-ff34f21d-529f-4840-8f53-65192980b2c8 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:19:21.642864 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-ff34f21d-529f-4840-8f53-65192980b2c8 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018095 Aug 04 16:19:21.643457 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 32/65] 10.222.0.77 () {60 vars in 1283 bytes} [Wed Aug 4 16:19:21 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:19:21.655990 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-aa962b7d-5900-408c-92d7-0d29787f93b4 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:19:21.665819 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-aa962b7d-5900-408c-92d7-0d29787f93b4 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013319 Aug 04 16:19:21.666396 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 34/66] 10.222.0.77 () {60 vars in 1286 bytes} [Wed Aug 4 16:19:21 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:19:21.678807 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-ef4bedaa-2fea-42b8-b82e-b0c55f7c8f25 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:19:21.687600 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-ef4bedaa-2fea-42b8-b82e-b0c55f7c8f25 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012418 Aug 04 16:19:21.688122 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 33/67] 10.222.0.77 () {60 vars in 1286 bytes} [Wed Aug 4 16:19:21 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:19:21.700207 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-c213ca34-da50-4102-9dde-0cf995643380 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:19:21.711137 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-c213ca34-da50-4102-9dde-0cf995643380 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014643 Aug 04 16:19:21.711700 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 35/68] 10.222.0.77 () {60 vars in 1283 bytes} [Wed Aug 4 16:19:21 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:20:42.930358 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-fcce8346-879a-4d2f-a9ba-3d7bdc06d29f tempest-verify_tempest_config-955061130 tempest-verify_tempest_config-955061130-project] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:20:42.932375 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-fcce8346-879a-4d2f-a9ba-3d7bdc06d29f tempest-verify_tempest_config-955061130 tempest-verify_tempest_config-955061130-project] 10.222.0.77 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121082 Aug 04 16:20:42.932905 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 34/69] 10.222.0.77 () {58 vars in 1134 bytes} [Wed Aug 4 16:20:42 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:22:16.856468 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-c213ca34-da50-4102-9dde-0cf995643380 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:22:16.857522 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-c213ca34-da50-4102-9dde-0cf995643380 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 04 16:22:16.857923 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 36/70] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:22:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:22:17.128890 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-f1bdd6d1-1e74-40ce-ae38-cb8a6012cac9 admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:22:17.130630 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:22:17.130630 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: warnings.warn(msg) Aug 04 16:22:17.132737 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-f1bdd6d1-1e74-40ce-ae38-cb8a6012cac9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:22:17.133215 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-f1bdd6d1-1e74-40ce-ae38-cb8a6012cac9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:22:17.134104 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-f1bdd6d1-1e74-40ce-ae38-cb8a6012cac9 admin admin] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:22:17.134566 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-f1bdd6d1-1e74-40ce-ae38-cb8a6012cac9 admin admin] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:22:17.174518 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-f1bdd6d1-1e74-40ce-ae38-cb8a6012cac9 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.170280 Aug 04 16:22:17.175099 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 35/71] 10.222.0.77 () {60 vars in 1194 bytes} [Wed Aug 4 16:22:17 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:22:18.558838 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: DEBUG nova.api.openstack.wsgi [None req-c213ca34-da50-4102-9dde-0cf995643380 admin admin] Calling method '>' {{(pid=92638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:22:18.560044 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: INFO nova.api.openstack.requestlog [None req-c213ca34-da50-4102-9dde-0cf995643380 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Aug 04 16:22:18.560477 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: [pid: 92638|app: 0|req: 37/72] 10.222.0.77 () {56 vars in 1075 bytes} [Wed Aug 4 16:22:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:22:18.753683 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG nova.api.openstack.wsgi [None req-87694d30-edb6-45be-af62-a9596262c33a admin admin] Calling method '>' {{(pid=92639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:22:18.754872 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:22:18.754872 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: warnings.warn(msg) Aug 04 16:22:18.756478 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-87694d30-edb6-45be-af62-a9596262c33a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:22:18.757105 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-87694d30-edb6-45be-af62-a9596262c33a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:22:18.758675 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-87694d30-edb6-45be-af62-a9596262c33a admin admin] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:22:18.759137 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: DEBUG oslo_concurrency.lockutils [None req-87694d30-edb6-45be-af62-a9596262c33a admin admin] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:22:18.782144 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: INFO nova.api.openstack.requestlog [None req-87694d30-edb6-45be-af62-a9596262c33a admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.079678 Aug 04 16:22:18.782713 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: [pid: 92639|app: 0|req: 36/73] 10.222.0.77 () {60 vars in 1194 bytes} [Wed Aug 4 16:22:18 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:23:14.254034 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: Wed Aug 4 16:23:14 2021 - graceful shutdown triggered... Aug 04 16:23:14.254178 dv-cinder-789564-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 16:23:14.255191 dv-cinder-789564-9-iscsi devstack@n-api.service[92639]: Gracefully killing worker 2 (pid: 92639)... Aug 04 16:23:14.255572 dv-cinder-789564-9-iscsi devstack@n-api.service[92638]: Gracefully killing worker 1 (pid: 92638)... Aug 04 16:23:15.256414 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: worker 1 buried after 1 seconds Aug 04 16:23:15.256414 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: worker 2 buried after 1 seconds Aug 04 16:23:15.256414 dv-cinder-789564-9-iscsi devstack@n-api.service[92637]: goodbye to uWSGI. Aug 04 16:23:15.257968 dv-cinder-789564-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 16:23:15.258535 dv-cinder-789564-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 16:23:15.261440 dv-cinder-789564-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 16:23:15.272165 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 16:23:15.274849 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 4 16:23:15 2021] *** Aug 04 16:23:15.275004 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 16:23:15.275157 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: nodename: dv-cinder-789564-9-iscsi Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: machine: x86_64 Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: clock source: unix Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: pcre jit disabled Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: detected number of CPU cores: 4 Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: current working directory: / Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: detected binary path: /usr/bin/uwsgi-core Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: your processes number limit is 47680 Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: your memory page size is 4096 bytes Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: detected max file descriptor number: 2048 Aug 04 16:23:15.275315 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: lock engine: pthread robust mutexes Aug 04 16:23:15.276070 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: thunder lock: enabled Aug 04 16:23:15.276070 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 16:23:15.276070 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 04 16:23:15.325749 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: Python main interpreter initialized at 0x5558a897f9c0 Aug 04 16:23:15.325749 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: python threads support enabled Aug 04 16:23:15.325749 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: your server socket listen backlog is limited to 100 connections Aug 04 16:23:15.325749 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: your mercy for graceful operations on workers is 90 seconds Aug 04 16:23:15.326211 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 16:23:15.326380 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: *** Operational MODE: preforking *** Aug 04 16:23:15.326634 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: *** uWSGI is running in multiple interpreter mode *** Aug 04 16:23:15.326634 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: spawned uWSGI master process (pid: 107538) Aug 04 16:23:15.326802 dv-cinder-789564-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 16:23:15.327484 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: spawned uWSGI worker 1 (pid: 107558, cores: 1) Aug 04 16:23:15.328968 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: spawned uWSGI worker 2 (pid: 107559, cores: 1) Aug 04 16:23:15.330189 dv-cinder-789564-9-iscsi devstack@n-api.service[107538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 16:23:17.183585 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:23:17.183585 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: from cryptography.utils import int_from_bytes Aug 04 16:23:17.184386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:23:17.184386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: from cryptography.utils import int_from_bytes Aug 04 16:23:17.199479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:23:17.199479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: from cryptography.utils import int_from_bytes Aug 04 16:23:17.200130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:23:17.200130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: from cryptography.utils import int_from_bytes Aug 04 16:23:19.780060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:23:19.780643 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:23:19.781196 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:23:19.781528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:23:19.781789 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:23:19.782214 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.782577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.782903 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.783231 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.783570 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.783883 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.784183 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.784540 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.784846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.785135 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.785448 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.785780 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-789564-9-iscsi {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.786132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.786441 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.786748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.787034 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:23:19.787456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.787543 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:23:19.787633 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.787712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.787783 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:23:19.788006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.788111 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:23:19.788368 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:23:19.788465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.788755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.789068 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.789398 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.789993 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.790237 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.790446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.790685 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.790891 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.791108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.791327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.791544 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.791761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.791978 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.792205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.792438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.792667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.792886 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.793099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.793311 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.793523 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-789564-9-iscsi {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.793745 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.793986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.794230 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.794442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.794655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-789564-9-iscsi {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.794889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.794889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.795282 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.795460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.795729 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.795894 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.796083 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.796243 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.796396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.796396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.796747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.796934 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.797087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.797087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.797087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.797508 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.797652 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.797884 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.798095 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.798255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.798409 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.798565 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.798714 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.798866 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.799023 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.799189 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.799350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.799526 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.799697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.799862 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.800819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-789564-9-iscsi {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.800988 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.801146 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.801302 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.801470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.801623 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.801793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.801940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.801940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.802273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.802687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.802837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.802989 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.803148 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.803299 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.803456 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.803601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.803750 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.803901 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.804069 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.804229 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.804383 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.804527 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.804770 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.804920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.805074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.805231 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.805387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.805546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.805689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.805843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.806058 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.806222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.806379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.806528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.806677 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.806822 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.806970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.807123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.807273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.807417 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.807568 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.807759 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.807931 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.808085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.808239 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.808383 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.808527 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.808668 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.808821 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.808980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.809130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.809130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.809410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.809568 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.809729 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.809879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.810088 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.810585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.810823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.810996 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.811142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.811297 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.811451 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.811604 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.811753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.811905 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.812061 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.812212 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.812365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.812526 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.812920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.813080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.813236 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.813387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.813538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.813693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.813854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.814035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.814195 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.814359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.814514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.814668 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.814825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.814825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.815115 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.815115 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.815402 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.815553 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.815707 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.815859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.816003 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.816151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.816311 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.816454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.816611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.816756 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.816911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.817057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.817211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.817363 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.817513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.817662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.817812 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.817992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.818142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.818307 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.818460 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.818603 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.818753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.818907 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.819058 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.819214 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.819365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.819507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.819649 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.819792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.819934 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.820106 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.820850 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821245 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821873 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821873 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.821873 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.822335 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.822480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.822629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.823066 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.823236 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.823389 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.823540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.823692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.823837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.823988 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.824147 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.824296 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.824440 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.824590 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.824743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.824895 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.825062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.825258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.825413 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.825564 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.825715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.825867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.826048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.826200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.826343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.826486 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.826635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.826822 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.826985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.827149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.827303 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.827454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.827686 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.827840 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.827991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.828136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.828293 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.828446 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.828625 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.828784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.828936 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.829080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.829256 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.829408 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.829559 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.829711 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.829862 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.830033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.830195 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.830340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.830483 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.831025 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.831266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.831430 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.831649 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.831817 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.831969 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.831969 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.832268 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.832424 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.832577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.832720 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.832871 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.833309 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.833473 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.833632 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.833783 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.833938 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.834120 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.834264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.834431 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.834589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.834743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.834895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.835046 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.835207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.835359 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.835502 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.835645 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.835789 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.835944 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.836101 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.836252 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.836396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.836547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.837024 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:23:19.837179 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.837335 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.837481 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.837624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.837769 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.837926 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.838119 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.838266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.838409 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.838551 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.838695 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.838838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.838990 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.839134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.839276 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.839425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.839585 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.839745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.839745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.840038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.840183 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.840334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.840492 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.840645 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.841171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.841426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.841586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.841731 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.841882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.842108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.842267 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.842525 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.842736 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.842901 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.843055 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.843641 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.843811 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.843957 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.844102 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.844246 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.844397 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.844549 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.844702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.844847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.845011 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.845166 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.845310 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.845453 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.845610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.845763 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.845763 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.846071 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.846227 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.846379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.846538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.846697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.846842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.846998 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.847150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.847304 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.847456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.847607 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.847759 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.847902 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.847902 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.848260 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.848415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.848560 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.848710 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.848861 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.849017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.849175 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.849327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.849479 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.849631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.849777 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.849920 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.850099 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.850256 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.850401 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.850551 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.850703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.850884 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.851608 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.851770 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.851924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.852068 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.852211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.852376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.852521 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.852671 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.852824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.852968 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.853111 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.853262 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.853664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.853925 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.854147 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.854303 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.854456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.854612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.854765 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.854910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.855053 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.855196 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.855349 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.855493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.855638 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.855799 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.855951 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.856095 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.856247 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.856391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.856543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.856689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.856831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.856974 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.857131 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.857283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.857436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.857587 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.857757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.857908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.858186 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.858343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.858496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.858795 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.858946 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.859097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.859257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.859402 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.859546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.859703 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.859867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.860025 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.860177 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.860329 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.860475 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.860618 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.860761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.860918 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.861090 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.861824 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.861998 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.862148 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.862293 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.862458 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.862611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.862611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.862895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.862895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.863184 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.863337 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.863483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.863867 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.864158 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.864308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.864466 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.864612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.864766 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.864909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865054 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865788 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865931 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.865931 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.866250 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.866395 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.866538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.866691 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.866834 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.866987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.867143 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.867297 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.867450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.867601 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.867746 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.867905 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.868059 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.868264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.868413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.868595 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.868880 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.869039 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.869192 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.869337 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.869480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.869623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.869767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.869922 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.870110 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.870266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.870410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.870561 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.870723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.870887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.871031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.871181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.871345 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.871981 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.872150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.872305 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.872451 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.872594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.872736 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.872879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.873031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.873194 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.873353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.873499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.873682 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.874014 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.874194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.874435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.874584 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.874744 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.874955 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.875131 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.875297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.875452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.875609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.875753 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.875897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.876052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.876198 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.876347 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.876491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.876642 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.876794 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.876951 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.877106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.877258 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.877403 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.877562 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.877715 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.877873 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.878050 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.878198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.878342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.878491 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.878642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.878801 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.879049 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.879208 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.879360 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.879516 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.879747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.879895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.880038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.880188 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.880340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.880493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.880645 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.880798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.880943 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.881161 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.881319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.881464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.882273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.882430 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.882575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.882718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.882718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.882999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.883157 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.883302 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.883452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.883596 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.883738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.883897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.884166 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.884337 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.884609 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.884767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.884913 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.885066 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.885219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.885364 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.885515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.885659 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.885810 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.885987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.886139 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.886295 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.886458 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.886610 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.886763 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.886915 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.887062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.887062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.887341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.887492 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.887645 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.887797 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.887987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.888137 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.888299 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.888452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.888606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.888759 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.888911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.889080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.889438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.889669 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.889878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.890083 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.890240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.890385 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.890528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.890720 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.890878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.890878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.891153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.891298 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.891448 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.891611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.892143 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.892501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.892661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.892804 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.892947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.893105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.893269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.893432 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.893577 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.893721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.893872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.894084 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.894366 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.894526 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.894806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.894957 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.895109 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.895263 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.895416 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.895578 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.895740 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.895898 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.896057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.896208 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.896356 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.896514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.896672 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.896823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.896986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.897138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.897296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.897457 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.897608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.897765 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.897925 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.898182 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.898336 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.898496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.898648 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.898798 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.898957 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.899126 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.899633 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.899802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.899967 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.899967 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.900278 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.900437 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.900596 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.900747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.900905 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.901067 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.901218 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.901375 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.901534 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.901692 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.901870 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.902408 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.902724 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.902891 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.903051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.903213 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.903374 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.903533 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.903684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.903835 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.903986 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.904135 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.904305 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.904588 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.904747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.905073 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.905240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.905400 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.905561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.905712 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.905869 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.906218 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.906402 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.906556 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.906706 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.906862 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.907034 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.907193 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.907344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.907500 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.907652 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.907845 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.908011 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.908175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.908328 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.908486 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.908637 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.908795 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.908954 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.909126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.909284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.909441 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.909694 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.909934 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.910188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.910353 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.910513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.910664 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.910827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.910978 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.911137 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.911287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.911456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.911622 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.911790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.911950 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.912101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.912640 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.912985 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.913143 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.913312 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.913464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.913621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.913772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.913921 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.914123 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.914279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.914436 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.914614 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.914904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.915079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.915371 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.915537 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.915696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.915856 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.916015 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.916166 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.916333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.916490 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.916648 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.916800 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.916949 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.917098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.917260 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.917412 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.917570 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.917730 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.917888 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.918085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.918239 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.918759 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.918919 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.918919 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.919225 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.919384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.919537 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.919686 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.919836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.920118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.920284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.920445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.920712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.920874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.921092 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.921346 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.921508 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.921680 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.921849 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.922062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.922219 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.922388 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.923226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.923389 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.923540 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.923699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.923851 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.924014 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.924174 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.924333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.924333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.924627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.924786 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.925093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.925093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.925556 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.925714 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.925877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.926055 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.926205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.926388 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.926540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.926690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.926839 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.926997 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.927156 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.927320 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.927471 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.927628 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.927788 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.927941 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.928099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.928263 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.928423 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.928581 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.928732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.928889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.929050 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.929202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.929359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.929510 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.929660 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.929808 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.929985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.930358 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.930632 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.930632 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.930928 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.930928 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.930928 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.931381 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.931532 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.931701 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.931862 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.932026 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.932187 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.932345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.932495 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.932495 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.932495 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.933632 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.933802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.933802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.934144 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.934297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.934446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.934614 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.934766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.934923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.934923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.935368 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.935368 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.935843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.936000 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.936194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.936348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.936348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.936657 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.936816 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.936967 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.937124 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.937274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.937425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.937605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.937764 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.937916 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.938095 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.938248 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.938410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.938575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.938575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.938948 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.939111 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.939269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.939420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.939586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.939757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.939908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.940058 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.940215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.940507 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.940665 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.940838 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.940992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.941144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.941301 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.941466 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.941634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.941785 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.941965 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942274 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.942436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.944427 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.944601 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.944754 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.944914 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.945065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.945230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.945401 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.945692 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.945868 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.946253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.946421 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.946421 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.946709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.946871 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.947034 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.947194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.947345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.947503 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.947660 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.947811 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.947970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.948132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.948291 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.948443 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.948591 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.948749 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.948910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.949080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.949238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.949397 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.949549 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.949699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.949857 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.950030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.950198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.950350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.951266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.951266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.951611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.951871 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.951871 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.952313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.952544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.952703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.952863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.952863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.953182 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.953995 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.954161 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.954330 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.954484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.954641 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.954813 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.954972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.955123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.955284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.955444 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.955603 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.955908 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.956073 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.956245 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.956543 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.956709 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.956860 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.957017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.957180 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.957338 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.957502 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.957660 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.957818 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.958086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.958248 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.958416 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.958567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.958716 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.958874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.959024 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.959181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.959356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.959517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.959675 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.959826 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.959976 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.960133 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.960293 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.960446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.960602 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.960753 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.960909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.961066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.961224 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.961517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.962208 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.962370 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.962522 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.962690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.962852 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.963003 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.963161 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.963312 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.963490 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.964277 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.964448 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.964624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.964783 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.964935 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.965099 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.965265 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.965424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.965583 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.965735 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.965915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.966102 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.966262 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.966428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.966738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.966908 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.967080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.967241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.967241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.967576 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.967726 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.967726 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.968033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.968185 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.968185 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.968537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.968689 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.968689 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.969012 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.969164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.969321 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.969478 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.969628 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.969860 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.969860 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.970230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.970382 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.970539 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.970696 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.970696 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.970992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.971160 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.971160 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.971480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.971750 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.971750 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.972061 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.972594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.972594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.972912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.973080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.973232 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.973382 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.973382 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.973680 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.974640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.974640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.974960 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.975112 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.975112 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.975413 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.975573 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.975573 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.975868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.976026 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.976178 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.976340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.976340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.976647 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.976949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.976949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.977261 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.977413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.977413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.977708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.977858 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.978103 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.978263 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.978412 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.978582 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.978582 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.978878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.979036 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.979036 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.979339 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.979519 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.979861 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.980027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.980793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.980952 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.981115 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.981351 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.981530 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.981694 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.981987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.982149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.982149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.982450 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.982602 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.982761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.982911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.982911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.983300 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.983459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.983880 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.984337 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.984909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.985078 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.985078 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.985369 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.985529 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.985682 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.985839 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.986067 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.986238 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.986407 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.986560 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.986717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.986878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.986878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.987321 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.987481 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.987639 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.987791 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.987940 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988298 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.988480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.989616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.989616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.989616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.989616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.989616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.989616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.989616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.990655 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.990844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.990844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.991143 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.991302 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.991454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.991604 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.991761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.991922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.992215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.992383 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.992533 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.992690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.992847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.993008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.993159 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.993307 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.993456 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.993615 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.993778 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.994020 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.994197 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.994569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.995175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.995342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.995507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.995661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.995812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.995970 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.996128 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.996279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.996437 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.996437 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.996740 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.996891 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.997060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.997238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.997536 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.997703 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.997856 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.998037 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.998197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.998361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.998513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.998701 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.998854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.999003 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.999177 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.999343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.999496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.999654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.999806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:19.999962 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.000114 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.000273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.000425 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.000581 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.000739 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.000897 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.001060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.001229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.001383 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.001781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.001877 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.001877 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.002051 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.002134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.002228 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.002309 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.002379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.002728 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.002863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.003150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.003150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.003417 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.003546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.003546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.003870 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.003960 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004127 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004127 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004755 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.004755 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005312 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005750 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005846 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.005940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006210 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006296 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006388 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006493 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006493 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006650 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006734 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.006909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007007 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007178 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007262 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007353 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007353 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007606 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007691 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007820 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.007956 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008056 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008236 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008236 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008390 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008814 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.008897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009060 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009146 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009330 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009423 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009516 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009516 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009516 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009756 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.009842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010595 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010688 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010688 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010688 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.010921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011491 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.011965 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.012756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.013117 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.013329 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.013463 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.013791 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.014150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.014384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.014721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.015207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.015545 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.015659 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.015876 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.015980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.016209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.016527 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.016627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.016854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.017204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.017365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.017530 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.017849 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.018113 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.018212 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.018515 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.018838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.018939 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.019149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.019433 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.019534 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.019773 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.020094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.020187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.020440 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.020748 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.020847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.021079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.021283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.021397 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.021727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.021826 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.022077 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.022264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.022410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.022720 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.022812 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.023057 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.023159 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.023374 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.023623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.023714 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.024019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.024116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.024343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.024551 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.024650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.024960 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.025066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.025352 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.025518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.025886 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.026011 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.026101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.026331 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.026423 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.026644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.026872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.026981 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.027276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.027463 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.027617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.027761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.027898 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.028031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.028326 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.028467 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.028595 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.028744 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.028880 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.029012 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.029282 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.029492 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.029692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.029875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.030046 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.030215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.030401 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.030543 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.030752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.030890 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.031072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.031212 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.031526 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.031693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.031908 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.032112 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.032281 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.032435 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.032580 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.032733 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.032977 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.033125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.033271 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.033435 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.033582 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.033727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.033887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.034134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:23:20.034294 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.034536 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.035387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.035942 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.036139 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.036412 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.036762 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.037081 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.037415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.037713 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.038079 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.038454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.038765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.039029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.039348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.039668 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.039986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.040339 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.040664 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.040984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.041341 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.041782 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.042142 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.042473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.042797 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.043123 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.043442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.043759 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.044106 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.044439 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.044766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.045122 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.045427 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.045842 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.046406 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.046727 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.047053 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.047384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.047702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.048045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.048396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.048732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.049066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.049379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.049715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.050058 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.050376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.050729 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.051078 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.051403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.051795 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.052075 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.052374 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.052816 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.053100 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.053421 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.053833 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.054318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.054644 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.054973 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.055401 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.055628 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.055953 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.056281 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.056595 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.056917 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.057234 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.057556 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.057898 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.058319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.058650 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.058964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.059170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_db.sqlalchemy.engines [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.059333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.059583 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.059911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.060239 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.060563 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.060886 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.061313 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.061634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.062011 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.062299 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.062617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.062933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.063251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.063589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.063923 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.064233 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.064566 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.064889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.065215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.065546 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.065858 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.066238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.066540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.066863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.067177 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.067492 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.067813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.068136 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.068466 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.068798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.069130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.069464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.069827 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.070169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.070524 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.070864 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:23:20.071114 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:23:20.097345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_db.sqlalchemy.engines [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.246889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.context [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9260958d-5d7e-4ff1-bc72-6315537cc5be(cell1) {{(pid=107558) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:23:20.251753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:23:20.253354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:23:20.254233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:23:20.256232 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:23:20.267673 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_db.sqlalchemy.engines [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.268556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_db.sqlalchemy.engines [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.273401 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.context [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9260958d-5d7e-4ff1-bc72-6315537cc5be(cell1) {{(pid=107559) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:23:20.278079 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:23:20.279811 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:23:20.280829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:23:20.282849 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:23:20.293920 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_db.sqlalchemy.engines [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.294809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_db.sqlalchemy.engines [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.542576 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_db.sqlalchemy.engines [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.562700 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_db.sqlalchemy.engines [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:23:20.868533 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: WARNING keystonemiddleware.auth_token [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:23:20.875344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: WARNING keystonemiddleware.auth_token [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:23:20.894229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: WARNING keystonemiddleware.auth_token [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:23:20.900937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: WARNING keystonemiddleware.auth_token [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:23:21.228340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: WARNING keystonemiddleware.auth_token [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:23:21.233940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: WARNING keystonemiddleware.auth_token [None req-4088c4fa-94fe-4de0-b361-1d6f532fc0a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:23:21.239573 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558a897f9c0 pid: 107558 (default app) Aug 04 16:23:21.263441 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: WARNING keystonemiddleware.auth_token [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:23:21.268892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: WARNING keystonemiddleware.auth_token [None req-fee48010-0a1b-47ba-9c62-6da1a227d3c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:23:21.274345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558a897f9c0 pid: 107559 (default app) Aug 04 16:23:55.634673 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1658d20d-560e-41a5-9bad-c6be6b80dfd2 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Action: 'create', calling method: .version_select at 0x7f2719982c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1591299045", "metadata": {"Type": "work"}}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:55.886586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e8f53e91-9e9d-457d-9a70-5f4c0927e02a tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Action: 'create', calling method: .version_select at 0x7f2719983c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-352566478"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:56.939029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1658d20d-560e-41a5-9bad-c6be6b80dfd2 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.600942 Aug 04 16:23:56.940404 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 1/1] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 4 16:23:54 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2605 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 16:23:57.133413 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e8f53e91-9e9d-457d-9a70-5f4c0927e02a tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.443996 Aug 04 16:23:57.135037 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 1/2] 10.222.0.77 () {60 vars in 1155 bytes} [Wed Aug 4 16:23:54 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2458 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 16:23:57.145845 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1392397941", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "adba0a6e-44f8-4a54-84d5-54ff0bc6bb41"}]}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:57.148452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-67bc6235-2a54-408d-91e2-4accf6e79e3b tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Calling method '.version_select at 0x7f27197d3670>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:57.285624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-67bc6235-2a54-408d-91e2-4accf6e79e3b tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a" status: 200 len: 353 microversion: 2.1 time: 0.141045 Aug 04 16:23:57.291237 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:23:57 2021] GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:57.299381 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-14016abd-afba-48e2-ae5b-49270bfab2f6 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f27197d3dc0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:57.380544 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] validate_networks() for [('adba0a6e-44f8-4a54-84d5-54ff0bc6bb41', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:23:57.443127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-14016abd-afba-48e2-ae5b-49270bfab2f6 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8" status: 200 len: 344 microversion: 2.1 time: 0.154956 Aug 04 16:23:57.448782 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 3/4] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:23:57 2021] GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:58.300116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b1ef3777-0f2f-4c68-839a-cdc65b935481 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Calling method '.version_select at 0x7f27197eb0d0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:58.517556 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b1ef3777-0f2f-4c68-839a-cdc65b935481 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a" status: 200 len: 354 microversion: 2.1 time: 0.222445 Aug 04 16:23:58.518812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 4/5] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:23:58 2021] GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a => generated 354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:23:58.527113 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3125a9b3-d375-45ae-a3b4-32c2dc8ebcd0 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f27197eb940>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:58.642246 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3125a9b3-d375-45ae-a3b4-32c2dc8ebcd0 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8" status: 200 len: 345 microversion: 2.1 time: 0.121949 Aug 04 16:23:58.643181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 5/6] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:23:58 2021] GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:58.649063 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-56c34f1e-5298-48f5-ac23-00a62febf37e tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Calling method '.version_select at 0x7f27197ebdc0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:58.809805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-56c34f1e-5298-48f5-ac23-00a62febf37e tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a" status: 200 len: 354 microversion: 2.1 time: 0.162457 Aug 04 16:23:58.809805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 6/7] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:23:58 2021] GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a => generated 354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:58.814952 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-919ab908-d56c-4c07-870e-bb76363713d4 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Action: 'create', calling method: .version_select at 0x7f27197eb430>, body: {"snapshot": {"volume_id": "79382379-8693-4a78-8303-9543f271fca8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-629001077"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:59.254985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-919ab908-d56c-4c07-870e-bb76363713d4 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.444830 Aug 04 16:23:59.255590 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 7/8] 10.222.0.77 () {60 vars in 1162 bytes} [Wed Aug 4 16:23:58 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:59.379435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-70405455", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "be014736-d92b-4d30-a9f9-4c1a86837735"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:59.589044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] validate_networks() for [('be014736-d92b-4d30-a9f9-4c1a86837735', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:23:59.775207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:23:59.775749 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:23:59.776376 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:23:59.776923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:23:59.777482 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:23:59.811023 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:23:59.812304 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:23:59.815081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:23:59.817122 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:23:59.900360 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:23:59.919737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for user b72fafb88f9f430ca1e561be656dda0f and project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:23:59.951265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:23:59.955203 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:24:00.149583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fd2db0fe-4a78-4661-b3a3-09f3df815785 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.197680 Aug 04 16:24:00.155841 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 2/9] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:23:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:24:00.172319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1d90885d-a81b-44f3-be12-ef5392292d6a tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Calling method '.version_select at 0x7f271975d820>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:00.337378 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1d90885d-a81b-44f3-be12-ef5392292d6a tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a" status: 202 len: 0 microversion: 2.1 time: 0.178891 Aug 04 16:24:00.338476 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 3/10] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 4 16:24:00 2021] DELETE /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:24:00.345252 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4c24c0ea-6a54-4a28-a7db-de708696cfc6 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f27196ed820>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:00.418221 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4c24c0ea-6a54-4a28-a7db-de708696cfc6 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260" status: 200 len: 286 microversion: 2.1 time: 0.078414 Aug 04 16:24:00.419266 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 4/11] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 4 16:24:00 2021] GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:00.424948 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-be3885a8-c2cf-492f-abdb-580cb15578b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:00.425791 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-be3885a8-c2cf-492f-abdb-580cb15578b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:00.661033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-be3885a8-c2cf-492f-abdb-580cb15578b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:00.686604 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-be3885a8-c2cf-492f-abdb-580cb15578b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1218 microversion: 2.1 time: 0.265830 Aug 04 16:24:00.689110 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 5/12] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:00 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1218 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:00.693982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-13a3a1d8-45ae-466b-bec1-d56da53c6351 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Calling method '.version_select at 0x7f27196fab80>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:00.809703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-13a3a1d8-45ae-466b-bec1-d56da53c6351 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a" status: 200 len: 353 microversion: 2.1 time: 0.118904 Aug 04 16:24:00.811894 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 6/13] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:24:00 2021] GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:00.816741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a1c7d2b2-2715-4c30-a4e1-b5ff473b1b5e tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f2718e93af0>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:00.913216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a1c7d2b2-2715-4c30-a4e1-b5ff473b1b5e tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.099948 Aug 04 16:24:00.913924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 7/14] 10.222.0.77 () {58 vars in 1140 bytes} [Wed Aug 4 16:24:00 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:00.927389 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e7208b5e-a6d5-4882-9398-af6f85a0b778 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f27196ed790>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:01.018529 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e7208b5e-a6d5-4882-9398-af6f85a0b778 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260" status: 200 len: 286 microversion: 2.1 time: 0.097391 Aug 04 16:24:01.019095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 8/15] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 4 16:24:00 2021] GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:24:01.654756 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:24:01.656018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:24:01.658234 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:24:01.659035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:24:01.660623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:24:01.689201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:01.690375 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:01.691623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:01.692343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:01.706502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a6f4835a-0d1c-437c-bbb7-c075fec7e543 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:01.707122 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a6f4835a-0d1c-437c-bbb7-c075fec7e543 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:01.744589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Getting quotas for project 3850dad1624c4086936f0a56a723b980. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:01.764896 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Getting quotas for user df66070b00d74211a323ea8de3f39a64 and project 3850dad1624c4086936f0a56a723b980. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:01.803263 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:24:01.806201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:24:01.966675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0d7f8b78-f774-4a65-b8b9-12e1f65e9db9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.708432 Aug 04 16:24:01.971535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 8/16] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:23:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 2715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:24:01.987367 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9643cfe7-bc63-4a49-99ba-c0e2db27c9bc tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Calling method '.version_select at 0x7f2719761c10>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:02.143087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9643cfe7-bc63-4a49-99ba-c0e2db27c9bc tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a" status: 200 len: 353 microversion: 2.1 time: 0.168919 Aug 04 16:24:02.152452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 9/17] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:24:01 2021] GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:02.158230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fcebc084-6dbe-4edb-918a-a71e12cefc4a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:02.159792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fcebc084-6dbe-4edb-918a-a71e12cefc4a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:02.231491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a6f4835a-0d1c-437c-bbb7-c075fec7e543 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:02.249561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a6f4835a-0d1c-437c-bbb7-c075fec7e543 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1218 microversion: 2.1 time: 0.546716 Aug 04 16:24:02.257823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 9/18] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:01 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1218 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:02.262766 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a19a14ac-473b-4b7a-a349-42687ea68b57 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f27196d5e50>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:02.339723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a19a14ac-473b-4b7a-a349-42687ea68b57 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260" status: 200 len: 286 microversion: 2.1 time: 0.080525 Aug 04 16:24:02.343230 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 10/19] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 4 16:24:02 2021] GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:02.400684 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fcebc084-6dbe-4edb-918a-a71e12cefc4a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:02.423594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fcebc084-6dbe-4edb-918a-a71e12cefc4a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1213 microversion: 2.1 time: 0.269718 Aug 04 16:24:02.431652 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 10/20] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:02 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1213 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:03.156680 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b1eda2e2-6f02-4ba3-9dd5-dc1632870ec1 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Calling method '.version_select at 0x7f27196faf70>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:03.203437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-b1eda2e2-6f02-4ba3-9dd5-dc1632870ec1 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] HTTP exception thrown: Volume 567cd4c0-1482-41fb-a94a-17f7f31ccb5a could not be found. Aug 04 16:24:03.210358 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b1eda2e2-6f02-4ba3-9dd5-dc1632870ec1 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] Returning 404 to user: Volume 567cd4c0-1482-41fb-a94a-17f7f31ccb5a could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:03.212031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b1eda2e2-6f02-4ba3-9dd5-dc1632870ec1 tempest-VolumesGetTestJSON-1259706382 tempest-VolumesGetTestJSON-1259706382-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a" status: 404 len: 109 microversion: 2.1 time: 0.059667 Aug 04 16:24:03.213090 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 11/21] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:24:03 2021] GET /compute/v2.1/os-volumes/567cd4c0-1482-41fb-a94a-17f7f31ccb5a => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:24:03.268700 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:03.270257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:03.295265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:03.296892 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:03.300868 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:03.305454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:03.503415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-668041802", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f965b80-7909-4cf3-8c57-8793402555a4"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:03.574292 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] validate_networks() for [('7f965b80-7909-4cf3-8c57-8793402555a4', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:24:03.653733 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:03.681650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c728d4fa-66d7-41f3-8bd7-0a7a592bbea6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1270 microversion: 2.1 time: 0.419029 Aug 04 16:24:03.686933 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 12/22] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:03 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1270 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:03.698535 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cac83ef2-0a51-47c3-aec0-2d08a39b7225 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f2718e43ee0>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:03.745085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cac83ef2-0a51-47c3-aec0-2d08a39b7225 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260" status: 200 len: 287 microversion: 2.1 time: 0.056806 Aug 04 16:24:03.746038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 13/23] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 4 16:24:03 2021] GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:03.752054 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:03.752905 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:03.768121 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:03.768841 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:03.770886 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:03.773387 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:03.921098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:03.931774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-534337ef-061f-44b9-8f03-61d9f3fdca5a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1209 microversion: 2.1 time: 0.183797 Aug 04 16:24:03.934356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 14/24] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:03 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1209 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:03.956126 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-378b125e-8b67-437d-a0fb-55e8ab126b38 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f2718e17ca0>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:04.072800 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-378b125e-8b67-437d-a0fb-55e8ab126b38 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "DELETE /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260" status: 202 len: 0 microversion: 2.1 time: 0.137104 Aug 04 16:24:04.073384 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 15/25] 10.222.0.77 () {58 vars in 1254 bytes} [Wed Aug 4 16:24:03 2021] DELETE /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:24:04.082140 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b3140e12-77f2-412e-bb3c-bfd9cff20f81 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f2718de4040>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:04.133993 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b3140e12-77f2-412e-bb3c-bfd9cff20f81 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260" status: 200 len: 286 microversion: 2.1 time: 0.055511 Aug 04 16:24:04.134970 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 16/26] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 4 16:24:04 2021] GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:24:04.703533 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:04.704222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:04.725976 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:04.726447 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:04.727236 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:04.729279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:04.903709 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:04.925081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f8863cab-fe24-4310-9ba2-95a2feb777a3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1276 microversion: 2.1 time: 0.225872 Aug 04 16:24:04.930327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 17/27] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:04 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:04.968071 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:04.968705 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:04.982976 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:04.983893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:04.984885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:04.985662 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:05.088249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:05.098629 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-69a6936c-f298-46f0-81eb-bf89b2fbdec6 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1271 microversion: 2.1 time: 0.134657 Aug 04 16:24:05.099545 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 18/28] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:04 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:05.146924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b014c52a-f739-448b-b6cc-5166cec35b8e tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f2718de4280>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:05.194747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-b014c52a-f739-448b-b6cc-5166cec35b8e tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] HTTP exception thrown: Snapshot c6c0608f-c625-48dc-8183-8a84b3abb260 could not be found. Aug 04 16:24:05.195655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b014c52a-f739-448b-b6cc-5166cec35b8e tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Returning 404 to user: Snapshot c6c0608f-c625-48dc-8183-8a84b3abb260 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:05.197085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b014c52a-f739-448b-b6cc-5166cec35b8e tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260" status: 404 len: 111 microversion: 2.1 time: 0.054165 Aug 04 16:24:05.204929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 19/29] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 4 16:24:05 2021] GET /compute/v2.1/os-snapshots/c6c0608f-c625-48dc-8183-8a84b3abb260 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:24:05.221793 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-dd9c8b1c-2357-4b1e-979a-72bc89abcb07 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f2718e17af0>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:05.346448 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-dd9c8b1c-2357-4b1e-979a-72bc89abcb07 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8" status: 202 len: 0 microversion: 2.1 time: 0.137773 Aug 04 16:24:05.347376 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 20/30] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 4 16:24:05 2021] DELETE /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:24:05.358394 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cf41e4b1-2b1c-49a6-9ca6-511237f76b52 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f27196fa8b0>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:05.525756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cf41e4b1-2b1c-49a6-9ca6-511237f76b52 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8" status: 200 len: 344 microversion: 2.1 time: 0.172295 Aug 04 16:24:05.526790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 21/31] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:24:05 2021] GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:05.852057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:24:05.853452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:24:05.854237 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:24:05.855143 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:24:05.855816 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:24:05.890642 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:05.895889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:05.902644 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:05.907230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:05.950275 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:05.952082 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:05.973354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:05.977155 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:05.979226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:05.981070 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:06.003725 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Getting quotas for project 5ed276298dcd40d9b792743496b57580. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:06.022956 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Getting quotas for user aab01db624484965967b062acee41252 and project 5ed276298dcd40d9b792743496b57580. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:06.114315 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:24:06.129421 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:24:06.245017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d1b0192f-1391-4772-81a3-c5d5c8b631bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.069172 Aug 04 16:24:06.246746 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 11/32] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:24:03 2021] POST /compute/v2.1/servers => generated 383 bytes in 3071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:24:06.276188 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:06.278037 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:06.299541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:06.306459 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:06.307432 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:06.311454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:06.424221 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:06.440841 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-845eefef-b0a4-49a4-875b-321894360a61 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1276 microversion: 2.1 time: 0.496335 Aug 04 16:24:06.458422 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 22/33] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:05 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1276 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:06.494847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6ef58ba4-1193-40b5-a5f7-f20126b9ff25 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:06.502465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6ef58ba4-1193-40b5-a5f7-f20126b9ff25 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:06.814619 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:06.853738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4178117f-0e2d-4254-b66d-2eb743ba3184 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1271 microversion: 2.1 time: 0.601485 Aug 04 16:24:06.873768 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 12/34] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:06 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1271 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:06.887251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-df1ac87e-0f2d-49ae-9c4d-fac174d2ef7c tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f2718dcee50>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:06.953972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-df1ac87e-0f2d-49ae-9c4d-fac174d2ef7c tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] HTTP exception thrown: Volume 79382379-8693-4a78-8303-9543f271fca8 could not be found. Aug 04 16:24:06.954889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-df1ac87e-0f2d-49ae-9c4d-fac174d2ef7c tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Returning 404 to user: Volume 79382379-8693-4a78-8303-9543f271fca8 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:06.957138 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-df1ac87e-0f2d-49ae-9c4d-fac174d2ef7c tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8" status: 404 len: 109 microversion: 2.1 time: 0.081863 Aug 04 16:24:06.958057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 13/35] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:24:06 2021] GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:24:07.006106 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-92df4268-c506-4b3b-a209-a73b3947c417 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f271a154040>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:07.099283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-92df4268-c506-4b3b-a209-a73b3947c417 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] HTTP exception thrown: Volume 79382379-8693-4a78-8303-9543f271fca8 could not be found. Aug 04 16:24:07.100449 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-92df4268-c506-4b3b-a209-a73b3947c417 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Returning 404 to user: Volume 79382379-8693-4a78-8303-9543f271fca8 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:07.102227 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-92df4268-c506-4b3b-a209-a73b3947c417 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8" status: 404 len: 109 microversion: 2.1 time: 0.125116 Aug 04 16:24:07.102843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6ef58ba4-1193-40b5-a5f7-f20126b9ff25 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:07.107535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 14/36] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 4 16:24:06 2021] DELETE /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:24:07.114059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0cdeb6d2-931f-43a7-a108-21f0448aea51 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Calling method '.version_select at 0x7f27196fcf70>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:07.120528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6ef58ba4-1193-40b5-a5f7-f20126b9ff25 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1221 microversion: 2.1 time: 0.660028 Aug 04 16:24:07.121304 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 23/37] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:06 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1221 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:07.195946 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-0cdeb6d2-931f-43a7-a108-21f0448aea51 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] HTTP exception thrown: Volume 79382379-8693-4a78-8303-9543f271fca8 could not be found. Aug 04 16:24:07.196563 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0cdeb6d2-931f-43a7-a108-21f0448aea51 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] Returning 404 to user: Volume 79382379-8693-4a78-8303-9543f271fca8 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:07.198224 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0cdeb6d2-931f-43a7-a108-21f0448aea51 tempest-VolumesSnapshotsTestJSON-1263871268 tempest-VolumesSnapshotsTestJSON-1263871268-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8" status: 404 len: 109 microversion: 2.1 time: 0.088086 Aug 04 16:24:07.198814 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 15/38] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:24:07 2021] GET /compute/v2.1/os-volumes/79382379-8693-4a78-8303-9543f271fca8 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:24:07.459344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:07.460412 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:07.485348 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:07.487914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:07.489907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:07.492075 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:07.540876 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-351598479", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f965b80-7909-4cf3-8c57-8793402555a4"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:07.736829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] validate_networks() for [('7f965b80-7909-4cf3-8c57-8793402555a4', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:24:09.732366 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:09.743183 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4ecedd2b-ad09-4896-9c99-8bc6808b1427 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 2.287580 Aug 04 16:24:09.748938 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 24/39] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:07 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:09.762538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:09.763367 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:09.798320 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:09.800064 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:09.802033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:09.805080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:11.369513 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:24:11.370186 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:24:11.370448 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:24:11.370868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:24:11.371280 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:24:11.385235 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:11.386495 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:11.396969 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:11.397247 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:11.481069 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Getting quotas for project 5ed276298dcd40d9b792743496b57580. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:11.503240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Getting quotas for user aab01db624484965967b062acee41252 and project 5ed276298dcd40d9b792743496b57580. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:11.556886 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:24:11.566928 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:24:11.730953 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-45c772bb-850b-458e-9609-5ea8b908c9d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.194552 Aug 04 16:24:11.732110 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 16/40] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:24:07 2021] POST /compute/v2.1/servers => generated 383 bytes in 4197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:24:12.114064 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-74da2b41-fb43-4546-8f87-36021cdada85 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Action: 'create', calling method: .version_select at 0x7f271a1540d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-430517957", "metadata": {"Type": "work"}}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:12.115689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-74da2b41-fb43-4546-8f87-36021cdada85 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:12.116574 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-74da2b41-fb43-4546-8f87-36021cdada85 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.373268 Aug 04 16:24:12.117740 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 17/41] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 4 16:24:11 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 375 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:24:12.143713 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:12.145612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:12.172634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:12.175552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:12.178523 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:12.181205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:12.866286 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:12.880353 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-408b80a4-3360-4701-93bf-323d1471fd68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.761572 Aug 04 16:24:12.884674 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 18/42] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:12 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:12.898728 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-305ab0f1-c34f-4417-80b7-a00e004894c0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:12.900414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-305ab0f1-c34f-4417-80b7-a00e004894c0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:13.080558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-305ab0f1-c34f-4417-80b7-a00e004894c0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:13.096319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-305ab0f1-c34f-4417-80b7-a00e004894c0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1221 microversion: 2.1 time: 0.209918 Aug 04 16:24:13.107098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 19/43] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:12 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:13.131016 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-807823d1-ec49-487c-abf1-c244e253412e tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Action: 'create', calling method: .version_select at 0x7f2718e23040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1843611947", "metadata": {"Type": "work"}}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:13.136352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-807823d1-ec49-487c-abf1-c244e253412e tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:13.139607 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-807823d1-ec49-487c-abf1-c244e253412e tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030627 Aug 04 16:24:13.149099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 20/44] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 4 16:24:13 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:24:13.162329 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f3856f71-ea1b-40b7-a3f5-4bf03a5692e3 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Action: 'create', calling method: .version_select at 0x7f2718dfc5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1113147434", "metadata": {"Type": "work"}}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:13.169504 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f3856f71-ea1b-40b7-a3f5-4bf03a5692e3 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:13.172276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f3856f71-ea1b-40b7-a3f5-4bf03a5692e3 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020265 Aug 04 16:24:13.174268 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 21/45] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 4 16:24:13 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:24:13.182255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:13.189150 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bd4b27a7-44c6-4da7-af5d-d5cc3b79f42b tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Calling method '.version_select at 0x7f2718e23f70>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:13.197421 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-436f428c-4184-459a-94e2-cd8d41b8a9d5 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 3.443271 Aug 04 16:24:13.201333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 25/46] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:09 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 3452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:13.276396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-bd4b27a7-44c6-4da7-af5d-d5cc3b79f42b tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] HTTP exception thrown: Volume tempest-invalid-195645721 could not be found. Aug 04 16:24:13.277426 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bd4b27a7-44c6-4da7-af5d-d5cc3b79f42b tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Returning 404 to user: Volume tempest-invalid-195645721 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:13.278681 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-bd4b27a7-44c6-4da7-af5d-d5cc3b79f42b tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/tempest-invalid-195645721" status: 404 len: 98 microversion: 2.1 time: 0.096990 Aug 04 16:24:13.279765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 22/47] 10.222.0.77 () {58 vars in 1215 bytes} [Wed Aug 4 16:24:13 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-195645721 => generated 98 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:24:13.292559 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-01ba810d-e950-42a0-91d0-767e1cf4d828 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005517 Aug 04 16:24:13.294022 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 26/48] 10.222.0.77 () {58 vars in 1140 bytes} [Wed Aug 4 16:24:13 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:24:13.305204 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8ea6f694-0555-4465-9740-8f6f2291d82f tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004539 Aug 04 16:24:13.312957 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 23/49] 10.222.0.77 () {58 vars in 1137 bytes} [Wed Aug 4 16:24:13 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:24:13.317894 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-84f1b434-b168-45fd-ae77-328ba7439eb1 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Calling method '.version_select at 0x7f2718e17f70>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:13.380914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-84f1b434-b168-45fd-ae77-328ba7439eb1 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] HTTP exception thrown: Volume 7c117a5e-2130-41b7-8d20-8f8c658c7625 could not be found. Aug 04 16:24:13.381558 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-84f1b434-b168-45fd-ae77-328ba7439eb1 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Returning 404 to user: Volume 7c117a5e-2130-41b7-8d20-8f8c658c7625 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:13.382666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-84f1b434-b168-45fd-ae77-328ba7439eb1 tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/7c117a5e-2130-41b7-8d20-8f8c658c7625" status: 404 len: 109 microversion: 2.1 time: 0.069727 Aug 04 16:24:13.387213 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 27/50] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 4 16:24:13 2021] DELETE /compute/v2.1/os-volumes/7c117a5e-2130-41b7-8d20-8f8c658c7625 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:24:13.397369 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1025c1bb-65ad-4ecd-b5ac-bab4e90cfadd tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Calling method '.version_select at 0x7f2718e23310>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:13.451091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-1025c1bb-65ad-4ecd-b5ac-bab4e90cfadd tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] HTTP exception thrown: Volume 1ef20915-8af6-44d3-a381-92e7cb96d8d9 could not be found. Aug 04 16:24:13.451956 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1025c1bb-65ad-4ecd-b5ac-bab4e90cfadd tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] Returning 404 to user: Volume 1ef20915-8af6-44d3-a381-92e7cb96d8d9 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:24:13.453032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1025c1bb-65ad-4ecd-b5ac-bab4e90cfadd tempest-VolumesNegativeTest-1136382756 tempest-VolumesNegativeTest-1136382756-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1ef20915-8af6-44d3-a381-92e7cb96d8d9" status: 404 len: 109 microversion: 2.1 time: 0.060855 Aug 04 16:24:13.453818 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 24/51] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:24:13 2021] GET /compute/v2.1/os-volumes/1ef20915-8af6-44d3-a381-92e7cb96d8d9 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:24:13.899844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:13.900507 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:13.912642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:13.915874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:13.921552 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:13.926159 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:14.132694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:14.133472 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:14.144623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:14.146055 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:14.150809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:14.151564 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:14.471285 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:14.514495 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-03934188-7a5e-4dc2-a489-692dad8ccd57 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1225 microversion: 2.1 time: 0.384624 Aug 04 16:24:14.522498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 25/52] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:14 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1225 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:14.534297 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:14.560799 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:14.584803 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:14.587009 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:14.588226 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:14.588809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:14.791083 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:14.799766 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0668f756-fbd0-4963-876a-1162b8dcb897 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.904642 Aug 04 16:24:14.803704 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 28/53] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:13 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:15.535958 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:15.537258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:15.551512 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:15.555985 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:15.557026 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:15.563514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:16.070819 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:16.091266 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-22f3ba9f-1839-475f-8a2f-d3b69faaba78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1273 microversion: 2.1 time: 0.561238 Aug 04 16:24:16.094333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 29/54] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:15 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1273 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:16.113806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:16.114463 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:16.144562 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:16.147683 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:16.152122 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:16.154621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:16.713146 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:16.738354 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7d4b5357-25f6-46bc-9004-e18de72b4b64 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 2.214583 Aug 04 16:24:16.746670 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 26/55] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:14 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:16.914203 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-d7ad9217-8f7c-416b-a054-645c3cf83ddf req-bd3fa6c3-5b28-448a-bc49-4285882c54c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fcb6970-bf7c-4e02-b6ed-b546eb86143a", "tag": "b924c080-25ef-46de-a092-6a7839885e48"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:16.918098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:16.918098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:16.949618 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-d7ad9217-8f7c-416b-a054-645c3cf83ddf req-bd3fa6c3-5b28-448a-bc49-4285882c54c6 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:16.953113 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-d7ad9217-8f7c-416b-a054-645c3cf83ddf req-bd3fa6c3-5b28-448a-bc49-4285882c54c6 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:16.977145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:16.996827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-62ec2949-a15b-4d31-a495-c4e6ec548812 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.891674 Aug 04 16:24:17.011449 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 30/56] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:16 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:17.024824 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-d7ad9217-8f7c-416b-a054-645c3cf83ddf req-bd3fa6c3-5b28-448a-bc49-4285882c54c6 service nova] Creating event network-changed:b924c080-25ef-46de-a092-6a7839885e48 for instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a on hv-cinder-78956 Aug 04 16:24:17.025579 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-d7ad9217-8f7c-416b-a054-645c3cf83ddf req-bd3fa6c3-5b28-448a-bc49-4285882c54c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 04 16:24:17.031892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ed9effd-11b3-482f-8400-27a4835003bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:17.032714 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ed9effd-11b3-482f-8400-27a4835003bd None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:17.034532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ed9effd-11b3-482f-8400-27a4835003bd None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:17.043204 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ed9effd-11b3-482f-8400-27a4835003bd None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:17.067605 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.compute.rpcapi [None req-2ed9effd-11b3-482f-8400-27a4835003bd None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 04 16:24:17.068640 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ed9effd-11b3-482f-8400-27a4835003bd None None] Releasing lock "compute-rpcapi-router" {{(pid=107559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 04 16:24:17.128373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2ed9effd-11b3-482f-8400-27a4835003bd None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379215 Aug 04 16:24:17.129248 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 27/57] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:17.137831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:17.139882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:17.160698 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:17.161249 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:17.166035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:17.166540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:17.204078 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d6ccd90d-37d9-418d-a660-d1d55fc0566d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'create', calling method: .version_select at 0x7f2718dfc430>, body: {"keypair": {"name": "tempest-keypair-1005129936"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:17.298596 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-d6ccd90d-37d9-418d-a660-d1d55fc0566d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:17.303209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-d6ccd90d-37d9-418d-a660-d1d55fc0566d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for user aa31f19acc464a5eb0f2620d763a964d and project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:17.554991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:17.566621 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-681fbea7-80f0-47d7-a850-517ea265dbb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1279 microversion: 2.1 time: 0.435910 Aug 04 16:24:17.587317 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 28/58] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:17 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1279 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:17.763979 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:17.765481 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:17.777980 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:17.778768 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:17.779964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:17.780588 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:17.803524 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-d6ccd90d-37d9-418d-a660-d1d55fc0566d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:17.827955 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-d6ccd90d-37d9-418d-a660-d1d55fc0566d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for user aa31f19acc464a5eb0f2620d763a964d and project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:17.895684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d6ccd90d-37d9-418d-a660-d1d55fc0566d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.849651 Aug 04 16:24:17.896514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 31/59] 10.222.0.77 () {60 vars in 1158 bytes} [Wed Aug 4 16:24:17 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:18.034975 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:18.037079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:18.056172 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:18.056612 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:18.057403 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:18.057848 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:18.066608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:18.075681 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4981b072-707c-4395-a9d5-7fbd5c6dd9cd tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.316229 Aug 04 16:24:18.079364 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 29/60] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:17 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:18.711251 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:18.720317 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-edd4e975-013d-4c5c-a934-9ec873d02c7d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.707356 Aug 04 16:24:18.734430 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 32/61] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:18 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:18.749680 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:18.751030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:18.778180 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:18.786395 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:18.787764 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:18.788518 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:19.169940 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d2e94588-68d3-44f8-badd-58375a45e7af tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'create', calling method: .version_select at 0x7f2718549430>, body: {"keypair": {"name": "tempest-keypair-1825984446"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:19.241343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d2e94588-68d3-44f8-badd-58375a45e7af tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:19.261539 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d2e94588-68d3-44f8-badd-58375a45e7af tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for user efcd395088e74895bd13523cbad21afc and project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:19.347664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:19.363356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e2f7aba6-1932-481b-8568-180be7114d52 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1279 microversion: 2.1 time: 0.626374 Aug 04 16:24:19.368619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 33/62] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:18 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1279 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:19.389706 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:19.390440 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:19.408855 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:19.418961 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:19.421985 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:19.426443 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:19.624818 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d2e94588-68d3-44f8-badd-58375a45e7af tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:19.631176 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d2e94588-68d3-44f8-badd-58375a45e7af tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for user efcd395088e74895bd13523cbad21afc and project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:19.673243 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d2e94588-68d3-44f8-badd-58375a45e7af tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.081903 Aug 04 16:24:19.677880 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 30/63] 10.222.0.77 () {62 vars in 1199 bytes} [Wed Aug 4 16:24:18 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1087 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:24:19.687766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-60273e20-3c28-4482-90ec-bfacb3fe6f09 req-3670d1d3-c012-4f78-af37-7c59033029f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb69746-5594-47c6-abfb-beffa84fb2ca", "tag": "b162335e-7c27-4531-a303-ef9867eb115e"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:19.690697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:19.690697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:19.713847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-60273e20-3c28-4482-90ec-bfacb3fe6f09 req-3670d1d3-c012-4f78-af37-7c59033029f0 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:19.714526 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-60273e20-3c28-4482-90ec-bfacb3fe6f09 req-3670d1d3-c012-4f78-af37-7c59033029f0 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:19.742584 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-60273e20-3c28-4482-90ec-bfacb3fe6f09 req-3670d1d3-c012-4f78-af37-7c59033029f0 service nova] Creating event network-changed:b162335e-7c27-4531-a303-ef9867eb115e for instance 3cb69746-5594-47c6-abfb-beffa84fb2ca on hv-cinder-78956 Aug 04 16:24:19.768206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-60273e20-3c28-4482-90ec-bfacb3fe6f09 req-3670d1d3-c012-4f78-af37-7c59033029f0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087791 Aug 04 16:24:19.771462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 31/64] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:19.783745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:19.784476 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:19.801373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:19.801724 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:19.804343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:19.805730 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:19.880825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:19.899851 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3e699152-fdd3-4bd2-95e1-0a8b234764c1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.529482 Aug 04 16:24:19.901002 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 34/65] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:19 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:20.286718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:20.295744 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f846001e-48be-4e7e-8593-556a5a802dad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.522937 Aug 04 16:24:20.296341 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 32/66] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:19 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:20.386616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:20.387735 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:20.400811 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:20.401496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:20.402520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:20.404189 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:20.919507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:20.920852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:20.944017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:20.946158 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:20.955099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:20.957284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:20.962308 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:20.972769 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3df02a7f-da63-4b9c-93d5-adcbc85d939c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.590307 Aug 04 16:24:20.984450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 35/67] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:20 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:21.318333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:21.321007 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:21.391566 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:21.405609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:21.407865 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:21.408353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:22.764721 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:22.776490 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2ab6f069-4f77-45c0-b7e3-e73ed332d4e8 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 1.862874 Aug 04 16:24:22.787471 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 33/68] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:20 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:22.800685 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:22.801655 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:22.810921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:22.811816 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:22.813229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:22.813886 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:23.310177 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:23.327275 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-80525ed1-23af-4de5-a3d5-24987bd7a628 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 2.017843 Aug 04 16:24:23.332640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 36/69] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:21 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:23.794404 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:23.795889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:23.803119 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:23.804225 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:23.805279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:23.805961 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:24.291388 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:24.299092 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1f536997-77ec-40c7-a04c-f4b460fcd406 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 1.510121 Aug 04 16:24:24.299707 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 34/70] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:22 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:24.342992 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:24.350863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:24.351445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:24.354428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b6fd001b-7c56-4d71-8886-3a73e5e334d9 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.563462 Aug 04 16:24:24.364380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 37/71] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:23 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:24.369520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:24.369993 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:24.370901 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:24.371344 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:24.506164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-0f3b40fb-c4c4-4350-8ae5-2653326f14f4 req-3aa77df1-1fc6-4ccf-8f7f-9b87530f1b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbda95db-cedf-447f-8281-789c89cd882c", "tag": "ad29e72d-4ed7-4bfa-82b0-e745f01f619a"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:24.509323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:24.509323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:24:24.521043 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-0f3b40fb-c4c4-4350-8ae5-2653326f14f4 req-3aa77df1-1fc6-4ccf-8f7f-9b87530f1b14 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:24.521822 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-0f3b40fb-c4c4-4350-8ae5-2653326f14f4 req-3aa77df1-1fc6-4ccf-8f7f-9b87530f1b14 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:24.547682 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-0f3b40fb-c4c4-4350-8ae5-2653326f14f4 req-3aa77df1-1fc6-4ccf-8f7f-9b87530f1b14 service nova] Creating event network-changed:ad29e72d-4ed7-4bfa-82b0-e745f01f619a for instance bbda95db-cedf-447f-8281-789c89cd882c on hv-cinder-78956 Aug 04 16:24:24.548525 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-0f3b40fb-c4c4-4350-8ae5-2653326f14f4 req-3aa77df1-1fc6-4ccf-8f7f-9b87530f1b14 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 04 16:24:24.550027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-04fceaa8-ac6e-404e-87b2-682fe75d6007 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:24.550703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-04fceaa8-ac6e-404e-87b2-682fe75d6007 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:24.551791 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-04fceaa8-ac6e-404e-87b2-682fe75d6007 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:24.552442 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-04fceaa8-ac6e-404e-87b2-682fe75d6007 None None] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:24.565941 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.compute.rpcapi [None req-04fceaa8-ac6e-404e-87b2-682fe75d6007 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 04 16:24:24.567634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-04fceaa8-ac6e-404e-87b2-682fe75d6007 None None] Releasing lock "compute-rpcapi-router" {{(pid=107558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 04 16:24:24.608175 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-04fceaa8-ac6e-404e-87b2-682fe75d6007 None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194179 Aug 04 16:24:24.608897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 38/72] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:24.891640 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:24.922989 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1df3d469-1fdf-4c07-9975-babba01cec19 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.575626 Aug 04 16:24:24.936061 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 35/73] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:24 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:25.035979 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-934416149", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c2558c7-24ce-41b2-b792-f9920a95bb2f"}], "security_groups": [{"name": "tempest-securitygroup--1268460539"}], "key_name": "tempest-keypair-1005129936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:25.057089 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-61b9a017-62ce-4e92-81d1-f6bd3578923e req-e790d4f1-051f-4f65-8c0b-45ffe1e4b979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b045ab-defa-4f38-8178-9d493b95c21c", "tag": "3c98fd1f-2d8e-4194-8ece-0d194fbe1a41"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:25.062021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:25.062021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:25.073662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-61b9a017-62ce-4e92-81d1-f6bd3578923e req-e790d4f1-051f-4f65-8c0b-45ffe1e4b979 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:25.074480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-61b9a017-62ce-4e92-81d1-f6bd3578923e req-e790d4f1-051f-4f65-8c0b-45ffe1e4b979 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:25.124362 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-61b9a017-62ce-4e92-81d1-f6bd3578923e req-e790d4f1-051f-4f65-8c0b-45ffe1e4b979 service nova] Creating event network-changed:3c98fd1f-2d8e-4194-8ece-0d194fbe1a41 for instance 64b045ab-defa-4f38-8178-9d493b95c21c on hv-cinder-78956 Aug 04 16:24:25.155441 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-61b9a017-62ce-4e92-81d1-f6bd3578923e req-e790d4f1-051f-4f65-8c0b-45ffe1e4b979 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100648 Aug 04 16:24:25.156306 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 36/74] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:25.295145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] validate_networks() for [('5c2558c7-24ce-41b2-b792-f9920a95bb2f', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:24:25.330198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:25.331912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:25.346800 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:25.349540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:25.350455 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:25.350904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:25.613823 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:25.630372 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9c4a3a89-ad86-4c2c-af96-f2298cde65b1 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.317734 Aug 04 16:24:25.631697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 37/75] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:25 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:25.638164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:25.639054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:25.646589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:25.647232 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:25.648295 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:25.648971 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:25.893763 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:25.902290 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-04010c03-b1b4-4582-b8fd-9a7f8130a1bf tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.269241 Aug 04 16:24:25.903683 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 38/76] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:25 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:25.943910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:25.944512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:25.951752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:25.952211 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:25.953303 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:25.953909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:26.174466 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:26.182865 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-14fdb76e-82c1-498e-92cc-c1f03026d8d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.243281 Aug 04 16:24:26.183491 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 39/77] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:25 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:26.204129 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-677100734", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3375530b-34ca-4462-9339-3ed10ebd346b"}], "security_groups": [{"name": "tempest-securitygroup--2005224692"}], "key_name": "tempest-keypair-1825984446", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:26.369423 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] validate_networks() for [('3375530b-34ca-4462-9339-3ed10ebd346b', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:24:26.646284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:24:26.646907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:24:26.647258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:24:26.647913 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:24:26.648631 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:24:26.660105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:26.661222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:26.662604 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:26.663607 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:26.687983 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:26.696379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for user aa31f19acc464a5eb0f2620d763a964d and project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:26.714098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:24:26.717195 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:24:26.793416 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2be5c66c-5966-4a84-8dd7-e9a9cbcd01e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.766500 Aug 04 16:24:26.795080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 39/78] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:24:25 2021] POST /compute/v2.1/servers => generated 402 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:24:26.800465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:26.801322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:26.807969 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:26.808657 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:26.809605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:26.810321 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:26.910529 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:24:26.910960 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:24:26.911435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:24:26.911843 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:24:26.912259 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:24:26.927977 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:26.928465 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:26.929297 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:26.931878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:26.994943 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for project e94f253973de4174807e633c0f67ea51. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:27.000519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for user efcd395088e74895bd13523cbad21afc and project e94f253973de4174807e633c0f67ea51. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:27.014315 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:24:27.017761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:24:27.025776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:27.041014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a7acdc6a-0d7b-42c1-86ac-357ecad6b870 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.244274 Aug 04 16:24:27.042201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 40/79] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:26 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:27.047392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-20b34848-538b-41c5-819f-1f1ca93b4d49 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:27.048699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-20b34848-538b-41c5-819f-1f1ca93b4d49 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:27.109140 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-967ceae2-0e2d-48f4-b244-28eca657ba4c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.914424 Aug 04 16:24:27.109807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 40/80] 10.222.0.77 () {62 vars in 1188 bytes} [Wed Aug 4 16:24:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:24:27.119881 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:27.120433 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:27.134567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:27.134823 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:27.135613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:27.136044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:27.180836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-20b34848-538b-41c5-819f-1f1ca93b4d49 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:27.190804 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-20b34848-538b-41c5-819f-1f1ca93b4d49 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1237 microversion: 2.1 time: 0.147222 Aug 04 16:24:27.193560 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 41/81] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:27 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1237 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:27.199646 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-96c2d4d3-b342-4fee-89d4-cd21eb1b66e4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:27.200911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-96c2d4d3-b342-4fee-89d4-cd21eb1b66e4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:27.313655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-96c2d4d3-b342-4fee-89d4-cd21eb1b66e4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:27.325932 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-96c2d4d3-b342-4fee-89d4-cd21eb1b66e4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:27.337265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-96c2d4d3-b342-4fee-89d4-cd21eb1b66e4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:27.338463 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-96c2d4d3-b342-4fee-89d4-cd21eb1b66e4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1281 microversion: 2.20 time: 0.143424 Aug 04 16:24:27.339038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 42/82] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:27 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:27.362735 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:27.363411 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:27.384889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:27.385343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:27.386200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:27.386654 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:27.692488 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:27.699980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d0e27dfc-65b1-405f-890e-d6ea7790577f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.347054 Aug 04 16:24:27.700606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 43/83] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:27 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:28.065747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:28.067088 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:28.073844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.074861 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.076170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.077095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.214963 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:28.224703 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fdd673dd-d50b-4641-b818-6cd1ae1436b3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 1.113188 Aug 04 16:24:28.224703 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 41/84] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:27 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:28.229562 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:28.230310 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:28.242322 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.243031 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.243955 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.244515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.403233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:28.415311 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a47a4cfd-8c60-4cba-9dac-f4da84889dc3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.353730 Aug 04 16:24:28.417359 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 44/85] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:28 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:28.433231 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:28.434291 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:28.445858 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.446937 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.448209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.449427 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.653798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:28.662581 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-52d7aa83-1532-4b4f-b97e-92696b2f8696 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1289 microversion: 2.1 time: 0.436596 Aug 04 16:24:28.666615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 42/86] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:28 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1289 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:28.719893 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:28.719893 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:28.728887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.729811 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.731021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:28.732029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:28.903225 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:28.919597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:28.922634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:28.924350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f27cc7a0-9d93-4b52-abf0-5265bc8abde1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1333 microversion: 2.20 time: 0.504091 Aug 04 16:24:28.925325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 45/87] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:28 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1333 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:29.242632 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:29.243328 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:29.254510 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.255436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:29.256726 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.258051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:29.518310 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:29.528919 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-63f38d94-93fa-4f36-bd9d-6b9505730a6d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.290666 Aug 04 16:24:29.530028 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 46/88] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:29 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:29.553234 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:29.558891 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:29.572451 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.577567 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:29.578464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.578895 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:29.665806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:29.675479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e16e8815-c114-44bb-9123-6caa376f6936 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.961541 Aug 04 16:24:29.676364 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 43/89] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:28 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:29.707579 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:29.710770 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:29.723207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.724429 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:29.726007 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.726794 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:29.875137 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:29.883723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-429d1b4e-7d53-43dd-bf80-9354186d4b12 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.340494 Aug 04 16:24:29.884628 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 47/90] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:29 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:29.899975 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:29.922847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3de53358-acc6-4963-9592-078eb8bdd69b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1295 microversion: 2.1 time: 0.235185 Aug 04 16:24:29.926902 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 44/91] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:29 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1295 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:29.948876 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:29.949864 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:29.959182 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.961459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:29.963256 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:29.963843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.066325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:30.078470 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:30.081553 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:30.083235 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-951342a8-42a8-4039-9e2e-79c40f0948de tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1339 microversion: 2.20 time: 0.141332 Aug 04 16:24:30.084717 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 48/92] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:29 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:30.546507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:30.547038 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:30.554838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.555550 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.556662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.557850 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.702667 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:30.703307 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:30.714587 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.715036 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.715863 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.716474 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.760599 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:30.768818 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-78100c05-c4a4-4a94-8f59-5843882b6ec2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.227024 Aug 04 16:24:30.769415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 45/93] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:30 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:30.900975 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:30.901715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:30.909090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.909748 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.911097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.912050 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.916436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:30.926992 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5b99e8f8-2dbd-4e58-9311-e2df655b80de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.236997 Aug 04 16:24:30.928069 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 49/94] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:30 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:30.942859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:30.944072 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:30.956692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.957593 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:30.958437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:30.959131 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:31.095313 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:31.103699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6158fc34-65c0-43fa-ba01-343849c66d7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.206751 Aug 04 16:24:31.104288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 46/95] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:30 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:31.114104 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:31.114887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:31.120973 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:31.121475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:31.122370 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:31.122857 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:31.176387 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:31.190459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e50eea9f-d4a1-45a5-a233-eae1ffa5d16e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.252356 Aug 04 16:24:31.192335 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 50/96] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:30 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:31.455016 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:31.463204 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:31.464719 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:31.465860 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-490c4409-f496-44d2-8d7a-646a4c798404 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.360417 Aug 04 16:24:31.466662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 47/97] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:31 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:31.791211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:31.791819 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:31.819473 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:31.820245 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:31.821626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:31.822342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:31.944766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:31.946069 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:31.952944 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:31.953706 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:31.954807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:31.955413 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:31.972145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:31.979616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b7323ebb-896f-4f12-8604-6e123ce07001 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.193708 Aug 04 16:24:31.990964 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 51/98] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:31 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:32.111981 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:32.120568 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:32.121462 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:32.126428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-291f9272-b820-47fe-93c2-c06238ba8f09 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.184061 Aug 04 16:24:32.128297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:32.128454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 48/99] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:31 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:32.129038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:32.129819 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:32.130416 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:32.218047 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:32.218595 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:32.224780 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:32.225421 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:32.226221 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:32.226798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:32.316461 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:32.326390 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f98db919-7bd8-4f5d-8593-12e3ba99f074 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.209209 Aug 04 16:24:32.328095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 52/100] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:32 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:32.418514 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:32.427466 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-22dd097c-9a75-4c67-8e6f-7432cd72cd9d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.214098 Aug 04 16:24:32.428673 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 49/101] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:32 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:32.484051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:32.484699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:32.492202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:32.494206 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:32.494994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:32.496569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:32.637489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:32.645844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:32.647387 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:32.651660 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-79c36e89-bc32-468d-983b-d0ac6a69e2fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.168473 Aug 04 16:24:32.652782 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 53/102] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:32 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:33.000954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:33.001486 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:33.017538 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.019430 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:33.023651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.024534 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:33.144755 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:33.145924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:33.152343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.153033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:33.155124 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.156056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:33.520523 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:33.528018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b3c2855e-b156-4619-be03-0dcd60bd7433 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.532101 Aug 04 16:24:33.539687 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 50/103] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:32 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:33.546433 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:33.547378 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:33.555585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.556260 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:33.557289 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.557923 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:33.681307 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:33.693331 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4c7b5b56-1c14-421f-a81c-0f004a104c7c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.552182 Aug 04 16:24:33.705233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 54/104] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:33 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:33.711505 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:33.712350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:33.721216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.721923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:33.722997 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:33.723623 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.068840 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:34.076732 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-224bd8bb-9700-4dce-943b-bf7c85b87771 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.369999 Aug 04 16:24:34.077333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 55/105] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:33 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:34.086122 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:34.086740 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:34.101917 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:34.102415 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.103208 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:34.103642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.183310 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:34.190995 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-de737c96-6ca1-41e6-b1e7-a9176e31cfef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.649399 Aug 04 16:24:34.205358 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 51/106] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:33 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:34.548124 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:34.549522 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:34.559785 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:34.562307 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.569259 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:34.569887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.630607 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:34.642510 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:34.644017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:34.649462 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e3f86b00-739b-4136-8865-cea7b9422e0f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.571131 Aug 04 16:24:34.650251 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 56/107] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:34 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:34.712113 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:34.712896 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:34.726674 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:34.728672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.734123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:34.734757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.823271 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:34.832526 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4757ddab-a455-4c9b-b726-e1f6daa878b0 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.289329 Aug 04 16:24:34.834935 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 52/108] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:34 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:34.841817 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-24214c9f-451b-4afe-9eed-96928a394c23 req-c29575df-1273-448c-9b44-8ed5517d7f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee88d756-5674-4fae-a650-a006454697e6", "tag": "63945f38-3e20-498c-9928-cc55b45b7533"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:34.846709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:34.846709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:34.855302 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-24214c9f-451b-4afe-9eed-96928a394c23 req-c29575df-1273-448c-9b44-8ed5517d7f25 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:34.856459 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-24214c9f-451b-4afe-9eed-96928a394c23 req-c29575df-1273-448c-9b44-8ed5517d7f25 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:34.874248 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-24214c9f-451b-4afe-9eed-96928a394c23 req-c29575df-1273-448c-9b44-8ed5517d7f25 service nova] Creating event network-changed:63945f38-3e20-498c-9928-cc55b45b7533 for instance ee88d756-5674-4fae-a650-a006454697e6 on hv-cinder-78956 Aug 04 16:24:34.880894 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-24214c9f-451b-4afe-9eed-96928a394c23 req-c29575df-1273-448c-9b44-8ed5517d7f25 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043623 Aug 04 16:24:34.881669 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 53/109] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:35.104016 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:35.105414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:35.122567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.123525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.124444 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.124987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.341609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:35.350244 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a27c04c9-4275-46fb-98b0-0c9df0b98119 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.643186 Aug 04 16:24:35.350832 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 57/110] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:34 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:35.364617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:35.366727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:35.367348 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:35.380198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3e258d0d-f81d-4a57-8064-cb3741ff0065 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.285850 Aug 04 16:24:35.381448 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.382189 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.383125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.383704 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.395118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 54/111] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:35 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:35.671911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:35.673025 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:35.680988 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.681942 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.683315 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.684164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.860741 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:35.880909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:35.882553 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:35.886689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-926770c4-b697-4d12-ada0-7873d8e78c35 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.220429 Aug 04 16:24:35.888305 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 55/112] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:35 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:24:35.904057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:35.904917 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:35.912237 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.912946 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.914190 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:35.915020 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:35.940420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:35.968903 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-00fdbf36-ab07-4950-b9b7-b9f2a337c5bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.594253 Aug 04 16:24:35.969855 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 58/113] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:35 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:36.074830 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:36.082648 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-030f908d-5be5-4165-ba42-9084e0b5348c tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.182727 Aug 04 16:24:36.083412 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 56/114] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:35 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:36.245329 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-03cb642d-b54a-410a-b917-56b30111e119 req-82bcec8d-2248-479f-82a7-b5bcb54dae96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb69746-5594-47c6-abfb-beffa84fb2ca", "name": "network-vif-plugged", "status": "completed", "tag": "b162335e-7c27-4531-a303-ef9867eb115e"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:36.246959 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:36.246959 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:24:36.255211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-03cb642d-b54a-410a-b917-56b30111e119 req-82bcec8d-2248-479f-82a7-b5bcb54dae96 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.255641 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-03cb642d-b54a-410a-b917-56b30111e119 req-82bcec8d-2248-479f-82a7-b5bcb54dae96 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.266758 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-03cb642d-b54a-410a-b917-56b30111e119 req-82bcec8d-2248-479f-82a7-b5bcb54dae96 service nova] Creating event network-vif-plugged:b162335e-7c27-4531-a303-ef9867eb115e for instance 3cb69746-5594-47c6-abfb-beffa84fb2ca on hv-cinder-78956 Aug 04 16:24:36.272276 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-03cb642d-b54a-410a-b917-56b30111e119 req-82bcec8d-2248-479f-82a7-b5bcb54dae96 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167526 Aug 04 16:24:36.273297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 59/115] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:36.367033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:36.367636 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:36.375354 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.376046 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.377066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.377535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.399580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:36.401324 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:36.410247 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.411125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.412094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.412737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.521356 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:36.529794 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d12808c7-f498-4054-b38a-bddce7672466 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.166366 Aug 04 16:24:36.530981 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 57/116] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:36 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:36.567103 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:36.574464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b1ed84ab-9a8b-4a8d-aee1-44e470cf2c4f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.178867 Aug 04 16:24:36.575543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 60/117] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:36 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:36.901566 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-50ddbd89-55f6-48ee-8c97-fa85ae29585b req-7370c4e0-763d-4629-90fa-955873ea4bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e525871-8d1f-4462-9cb5-7e3aeb9c3977", "tag": "0da0ab28-3f37-48ae-94a1-42c44e08a854"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:36.903215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:36.903215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:36.909150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:36.909906 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:36.910696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-50ddbd89-55f6-48ee-8c97-fa85ae29585b req-7370c4e0-763d-4629-90fa-955873ea4bbb service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.911195 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-50ddbd89-55f6-48ee-8c97-fa85ae29585b req-7370c4e0-763d-4629-90fa-955873ea4bbb service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.920134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.920761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.921710 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.922398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.923814 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-50ddbd89-55f6-48ee-8c97-fa85ae29585b req-7370c4e0-763d-4629-90fa-955873ea4bbb service nova] Creating event network-changed:0da0ab28-3f37-48ae-94a1-42c44e08a854 for instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 on hv-cinder-78956 Aug 04 16:24:36.929779 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-50ddbd89-55f6-48ee-8c97-fa85ae29585b req-7370c4e0-763d-4629-90fa-955873ea4bbb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031782 Aug 04 16:24:36.931013 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 58/118] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:36.989126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:36.989813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:36.998020 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:36.998660 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:36.999584 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:37.000272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:37.068465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:37.077273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:37.079060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:37.080178 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e18b765f-6ac0-484e-81fb-4a8591bca1f2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.178344 Aug 04 16:24:37.080743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 61/119] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:36 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:24:37.100476 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:37.101106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:37.115117 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:37.115801 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:37.116583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:37.117161 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:37.167131 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:37.180082 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4304203c-5947-4385-8b73-b740dd3ed458 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.195061 Aug 04 16:24:37.181010 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 59/120] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:36 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:37.291297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:37.299184 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-83f660fa-5838-4115-9256-8d4f0b769ee1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.202434 Aug 04 16:24:37.300010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 62/121] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:37 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:37.547039 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:37.548350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:37.554520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:37.555031 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:37.556024 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:37.557659 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:37.592944 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:37.593621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:37.603692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:37.604228 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:37.605579 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:37.606219 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:37.720062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:37.730105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-bebd9faa-e564-480f-b38f-98a3829050cf tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.186648 Aug 04 16:24:37.730699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 60/122] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:37 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:37.772988 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:37.780813 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c5897044-aef1-4eec-a4fe-b3f6eb33a85d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.192006 Aug 04 16:24:37.781797 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 63/123] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:37 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:38.102235 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:38.102954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:38.109206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.109737 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.110555 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.111120 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.203226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:38.203836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:38.211502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.211971 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.212707 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.213188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.242367 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:38.253722 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:38.255308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:38.256393 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-195add98-11d7-4248-b364-b051170414a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.158064 Aug 04 16:24:38.256966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 61/124] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:38 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:38.315935 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:38.316709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:38.328865 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.332947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.334547 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.335077 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.375227 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:38.383215 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-535c1375-13ab-4802-9c9b-db6f5bbe9704 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.183936 Aug 04 16:24:38.383806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 64/125] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:38 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:38.472869 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:38.480570 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7770ccca-371f-4a26-b43e-ac55e7d3f911 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.168561 Aug 04 16:24:38.481137 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 62/126] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:38 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:38.754069 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:38.755012 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:38.775171 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.775612 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.776389 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.776823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.799561 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:38.801396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:38.815506 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.817360 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:38.820432 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:38.822296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.249106 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:39.257019 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-797c4cc3-6ead-4863-9338-fef59eda0916 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.462072 Aug 04 16:24:39.270361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 63/127] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:38 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:39.275272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-4bbccc7b-e436-4d9a-8116-efb780534d0f req-fdb5d83f-fe04-4401-ae35-789c80b29ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcb6970-bf7c-4e02-b6ed-b546eb86143a", "name": "network-vif-plugged", "status": "completed", "tag": "b924c080-25ef-46de-a092-6a7839885e48"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:39.277001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:39.277001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:39.290373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-4bbccc7b-e436-4d9a-8116-efb780534d0f req-fdb5d83f-fe04-4401-ae35-789c80b29ad9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:39.291028 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-4bbccc7b-e436-4d9a-8116-efb780534d0f req-fdb5d83f-fe04-4401-ae35-789c80b29ad9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.305868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-4bbccc7b-e436-4d9a-8116-efb780534d0f req-fdb5d83f-fe04-4401-ae35-789c80b29ad9 service nova] Creating event network-vif-plugged:b924c080-25ef-46de-a092-6a7839885e48 for instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a on hv-cinder-78956 Aug 04 16:24:39.313771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-4bbccc7b-e436-4d9a-8116-efb780534d0f req-fdb5d83f-fe04-4401-ae35-789c80b29ad9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042068 Aug 04 16:24:39.314961 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 64/128] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:39.340088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:39.341275 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:39.348209 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:39.348984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.350207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:39.350841 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.366859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:39.405663 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-56d9a9f5-5138-4543-b862-ab0ac4ff56fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.655132 Aug 04 16:24:39.407104 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 65/129] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:38 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:39.418613 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:39.419815 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:39.433767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:39.434629 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.436746 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:39.437702 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.634140 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:39.657126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:39.663056 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:39.666823 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-404623c5-b7a2-4bbb-b3e7-f9c433d6529c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.348746 Aug 04 16:24:39.667665 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 65/130] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:39 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:39.697901 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:39.700922 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:39.715107 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:39.715418 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.716262 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:39.718652 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:39.904890 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:39.916101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-78770937-0fd8-497d-8d0f-94b06ade1e09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.506209 Aug 04 16:24:39.918303 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 66/131] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:39 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:39.933063 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:39.942256 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-293840c2-53f1-4be6-a0d1-763a7ec15d9b tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.272197 Aug 04 16:24:39.943088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 66/132] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:39 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:40.276657 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:40.277270 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:40.283343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.283774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.284828 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.285445 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.424169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:40.425118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:40.439395 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.441140 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.443290 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.444889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.619875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:40.631341 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0617ee66-9047-4657-abfa-b747a8a8a076 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1318 microversion: 2.1 time: 0.211573 Aug 04 16:24:40.632976 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 67/133] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:40 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:40.633747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:40.649416 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f3594c65-53a8-4aad-af9a-b57c0ea50680 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.376207 Aug 04 16:24:40.659921 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 67/134] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:40 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:40.685781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:40.686418 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:40.693685 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.695837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.697835 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.707847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.883840 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:40.893984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:40.895521 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:40.896903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fba4af5d-02ba-425a-b6de-bed8fe30ccda tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.214862 Aug 04 16:24:40.904842 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 68/135] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:40 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:40.936312 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:40.936312 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:40.943581 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.944032 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.944814 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.945243 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.961234 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:40.962310 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:40.971776 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.972873 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:40.973662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:40.974122 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:41.139333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:41.149819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-476de82b-46b7-49cd-982a-541751d78a82 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1313 microversion: 2.1 time: 0.193562 Aug 04 16:24:41.159626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 69/136] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:40 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:41.311751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:41.352194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1311843b-4341-4124-8652-cb31b8d922cc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.421600 Aug 04 16:24:41.352802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 68/137] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:40 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:41.649612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:41.650600 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:41.659973 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:41.660838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:41.662532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:41.663327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:41.674400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:41.675246 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:41.684292 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:41.685014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:41.686313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:41.687684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:41.823315 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:41.832830 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-99728b5a-1d57-48b6-a164-e5cd3d401aad tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1509 microversion: 2.1 time: 0.187478 Aug 04 16:24:41.835805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 70/138] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:41 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:41.841706 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-7ae7acd7-8630-401e-b9cb-b3bd440a57b0 req-8d09ca3e-1b57-41d8-83b2-6313e19951a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b045ab-defa-4f38-8178-9d493b95c21c", "name": "network-vif-plugged", "status": "completed", "tag": "3c98fd1f-2d8e-4194-8ece-0d194fbe1a41"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:41.843622 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:41.843622 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:41.864514 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-7ae7acd7-8630-401e-b9cb-b3bd440a57b0 req-8d09ca3e-1b57-41d8-83b2-6313e19951a1 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:41.868602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-7ae7acd7-8630-401e-b9cb-b3bd440a57b0 req-8d09ca3e-1b57-41d8-83b2-6313e19951a1 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:41.871617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:41.882040 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-7ae7acd7-8630-401e-b9cb-b3bd440a57b0 req-8d09ca3e-1b57-41d8-83b2-6313e19951a1 service nova] Creating event network-vif-plugged:3c98fd1f-2d8e-4194-8ece-0d194fbe1a41 for instance 64b045ab-defa-4f38-8178-9d493b95c21c on hv-cinder-78956 Aug 04 16:24:41.887702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-7ae7acd7-8630-401e-b9cb-b3bd440a57b0 req-8d09ca3e-1b57-41d8-83b2-6313e19951a1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050175 Aug 04 16:24:41.889283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 71/139] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:41.890731 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8a70183c-0506-46ef-8305-795a6cb4ad32 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.225840 Aug 04 16:24:41.893873 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 69/140] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:41 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:41.916133 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:41.916869 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:41.936238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:41.937302 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:41.938284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:41.939655 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:42.117470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:42.127905 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:42.131500 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:42.136055 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-24b916ee-3362-4f89-8b28-a9bf0a209caa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.222947 Aug 04 16:24:42.136784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 72/141] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:41 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:42.170127 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:42.171433 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:42.185674 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:42.187094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:42.192437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:42.193929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:42.370478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:42.371089 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:42.377133 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:42.377837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:42.378610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:42.379067 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:42.387156 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:42.396209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4f7eb85c-6663-4e01-a663-56b8bd7e08e3 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1499 microversion: 2.1 time: 0.231217 Aug 04 16:24:42.397353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 70/142] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:42 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1499 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:42.533608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:42.541440 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6a563a7d-75c4-4595-b579-1e67a74f73f3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.174554 Aug 04 16:24:42.542380 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 73/143] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:42 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:42.912369 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:42.913078 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:42.920218 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:42.920689 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:42.921517 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:42.921980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.055705 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:43.063506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6b7c5c15-6997-41a0-a27c-8db4ab46a9f5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.155097 Aug 04 16:24:43.064191 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 71/144] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:42 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:43.156496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:43.157130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:43.163155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.163672 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.164448 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.164933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.304587 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:43.312809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:43.314378 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:43.315495 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d649af47-0a87-46d7-97f4-57c39bab24ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.163238 Aug 04 16:24:43.316076 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 74/145] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:43 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:24:43.411495 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0e3f778d-292c-448b-8924-0c60261e184a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbb51ea9-50dc-4f17-acdd-11b374c91a8c"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:43.412784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0e3f778d-292c-448b-8924-0c60261e184a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:43.419670 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e3f778d-292c-448b-8924-0c60261e184a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.420348 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e3f778d-292c-448b-8924-0c60261e184a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.421519 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e3f778d-292c-448b-8924-0c60261e184a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.421972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e3f778d-292c-448b-8924-0c60261e184a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.559793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:43.560784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:43.566870 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.567456 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.568428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.569069 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.721077 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:43.729943 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c64d89d1-f7ce-49c6-a902-a7451fedb20b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.174061 Aug 04 16:24:43.730549 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 75/146] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:43 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:43.834207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0e3f778d-292c-448b-8924-0c60261e184a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426279 Aug 04 16:24:43.837123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 72/147] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:24:43 2021] POST /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:43.861690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-54afb6b3-2e44-4fd8-b02a-9b528b84986a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4ebcc79-4409-4016-a420-eee6fa661fbb"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:43.864749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-54afb6b3-2e44-4fd8-b02a-9b528b84986a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:43.883442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-54afb6b3-2e44-4fd8-b02a-9b528b84986a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.883442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-54afb6b3-2e44-4fd8-b02a-9b528b84986a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.883442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-54afb6b3-2e44-4fd8-b02a-9b528b84986a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.883442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-54afb6b3-2e44-4fd8-b02a-9b528b84986a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:43.968899 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-5f31152a-ce3a-457a-8148-f2355f7335a6 req-31e74347-b4ec-4b1d-a52c-993d1416b189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbda95db-cedf-447f-8281-789c89cd882c", "name": "network-vif-plugged", "status": "completed", "tag": "ad29e72d-4ed7-4bfa-82b0-e745f01f619a"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:43.972787 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:43.972787 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:24:43.991490 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-5f31152a-ce3a-457a-8148-f2355f7335a6 req-31e74347-b4ec-4b1d-a52c-993d1416b189 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:43.991937 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-5f31152a-ce3a-457a-8148-f2355f7335a6 req-31e74347-b4ec-4b1d-a52c-993d1416b189 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:44.020338 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-5f31152a-ce3a-457a-8148-f2355f7335a6 req-31e74347-b4ec-4b1d-a52c-993d1416b189 service nova] Creating event network-vif-plugged:ad29e72d-4ed7-4bfa-82b0-e745f01f619a for instance bbda95db-cedf-447f-8281-789c89cd882c on hv-cinder-78956 Aug 04 16:24:44.035879 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-5f31152a-ce3a-457a-8148-f2355f7335a6 req-31e74347-b4ec-4b1d-a52c-993d1416b189 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078040 Aug 04 16:24:44.038578 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 73/148] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:24:44.084380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:44.086580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:44.095028 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:44.095774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:44.096698 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:44.097274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:44.429401 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:44.441214 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2cd881b5-59d8-4fad-bf95-e9d664f1c2b9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.363234 Aug 04 16:24:44.442447 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 74/149] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:44 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:44.450609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:44.452033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:44.463535 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:44.467099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-54afb6b3-2e44-4fd8-b02a-9b528b84986a tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "POST /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617953 Aug 04 16:24:44.468342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:44.469813 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:44.470314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 76/150] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:24:43 2021] POST /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:44.473690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:44.736606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:44.749198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:44.750135 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:44.756186 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:44.758113 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:44.759325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-712a7517-ae0a-488e-9fed-297d9e063b44 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.315146 Aug 04 16:24:44.760276 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 75/151] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:44 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:44.761195 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:44.761697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:44.762537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:44.763187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:44.947030 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:44.967882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4c8ccff7-3992-49f9-a3a0-fbb3b997b904 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1321 microversion: 2.1 time: 0.221920 Aug 04 16:24:44.970112 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 77/152] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:44 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:45.461077 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:45.462500 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:45.470836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:45.471300 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:45.472098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:45.472524 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:45.709651 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:45.718187 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-27d6b335-75b8-452d-bcfb-722bae01b57c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.261057 Aug 04 16:24:45.718912 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 76/153] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:45 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:45.778447 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:45.779812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:45.787114 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:45.787879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:45.788665 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:45.789089 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:45.969808 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:45.985907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:45.986664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:46.003405 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:46.005591 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.006153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:46.007173 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.007821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:46.009416 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:46.010942 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-191182aa-736c-43a4-824b-fe4a3285417b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.237225 Aug 04 16:24:46.011602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 78/154] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:45 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:46.195618 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:46.207573 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-caf19274-27f2-4576-b1b1-9933d96e8758 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1514 microversion: 2.1 time: 0.226047 Aug 04 16:24:46.220710 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 77/155] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:45 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:46.226059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:46.227668 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:46.234831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.235705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:46.236781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.237848 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:46.261785 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lazy-loading 'flavor' on Instance uuid bbda95db-cedf-447f-8281-789c89cd882c {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:24:46.384953 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-dafd440c-fe74-415d-b68a-b058dc5b10be tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c/action" status: 200 len: 32 microversion: 2.1 time: 0.162877 Aug 04 16:24:46.385604 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 79/156] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:24:46 2021] POST /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:24:46.402301 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:46.403259 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:46.409687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.410182 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:46.411153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.411582 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:46.624827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:46.635567 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7c5ed139-a935-4245-93e6-87aa24df87b4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.243935 Aug 04 16:24:46.636531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 78/157] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:46 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:46.744076 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:46.744945 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:46.760199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.760651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:46.766379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:46.767176 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:47.001431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:47.012975 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c1f16dfe-fee9-4260-a469-b244e68090d3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.280526 Aug 04 16:24:47.014385 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 80/158] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:46 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:47.034004 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:47.036779 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:47.047669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:47.048132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:47.048984 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:47.049457 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:47.225060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:47.244814 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:47.247650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:47.249708 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c18b7e40-2be1-4641-a8ca-8f1b19be18f3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.222905 Aug 04 16:24:47.250646 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 79/159] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:47 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:47.653363 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:47.654169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:47.669921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:47.671454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:47.673274 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:47.674304 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:47.836130 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-c1152d0b-0afd-4be8-8158-c11ab6f9feab req-c6ad4c95-ed33-4b7c-aebc-3b4235724dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e525871-8d1f-4462-9cb5-7e3aeb9c3977", "name": "network-vif-plugged", "status": "completed", "tag": "0da0ab28-3f37-48ae-94a1-42c44e08a854"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:47.838731 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:47.838731 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:24:47.847411 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:47.858994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-c1152d0b-0afd-4be8-8158-c11ab6f9feab req-c6ad4c95-ed33-4b7c-aebc-3b4235724dca service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:47.859901 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-c1152d0b-0afd-4be8-8158-c11ab6f9feab req-c6ad4c95-ed33-4b7c-aebc-3b4235724dca service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:47.867481 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-53421f16-0636-4bdf-a99e-b853eff19fac tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.217059 Aug 04 16:24:47.869467 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 81/160] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:47 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:47.880058 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-c1152d0b-0afd-4be8-8158-c11ab6f9feab req-c6ad4c95-ed33-4b7c-aebc-3b4235724dca service nova] Creating event network-vif-plugged:0da0ab28-3f37-48ae-94a1-42c44e08a854 for instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 on hv-cinder-78956 Aug 04 16:24:47.895201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-c1152d0b-0afd-4be8-8158-c11ab6f9feab req-c6ad4c95-ed33-4b7c-aebc-3b4235724dca service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065253 Aug 04 16:24:47.897726 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 80/161] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:24:48.034432 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:48.036313 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:48.046129 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:48.046631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:48.047438 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:48.047874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:48.206818 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:48.214688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-26438f38-61d8-4b65-8fd9-c0da0eabedde tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.185861 Aug 04 16:24:48.215255 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 82/162] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:48 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:48.269902 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:48.270671 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:48.277279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:48.277723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:48.282190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:48.282642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:48.425210 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:48.433965 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:48.435786 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:48.437069 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-674c6d8b-adb8-4d19-bb2d-4743449e318d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1407 microversion: 2.20 time: 0.171641 Aug 04 16:24:48.437815 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 81/163] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:48 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:48.892815 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:48.893436 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:48.900048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:48.900509 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:48.901347 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:48.901760 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.032694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:49.040938 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b55ad3b3-da40-4456-adb0-4bc4ed4cec74 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.153027 Aug 04 16:24:49.041506 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 83/164] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:48 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:49.230932 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:49.231521 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:49.237744 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:49.238193 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.239050 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:49.239669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.376103 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:49.386046 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-10d34f82-31bf-4e56-9d73-3dbf3e319450 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.158686 Aug 04 16:24:49.386734 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 82/165] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:49 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:49.456829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:49.457598 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:49.465677 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:49.466319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.467504 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:49.468110 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.613483 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:49.621521 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:49.622980 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:49.624215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0749ce35-5063-46cc-8bdd-f71efdfb1cdb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1599 microversion: 2.20 time: 0.171883 Aug 04 16:24:49.624775 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 84/166] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:24:49 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:49.642343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4bd5f0b3-3730-4348-8a21-d9d83e849fe1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:49.642853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4bd5f0b3-3730-4348-8a21-d9d83e849fe1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:49.648950 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4bd5f0b3-3730-4348-8a21-d9d83e849fe1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:49.649402 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4bd5f0b3-3730-4348-8a21-d9d83e849fe1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.650199 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4bd5f0b3-3730-4348-8a21-d9d83e849fe1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:49.650650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4bd5f0b3-3730-4348-8a21-d9d83e849fe1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.746081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4bd5f0b3-3730-4348-8a21-d9d83e849fe1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107691 Aug 04 16:24:49.746753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 83/167] 10.222.0.77 () {60 vars in 1316 bytes} [Wed Aug 4 16:24:49 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:24:49.914127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-9b0e50aa-b7f2-4609-8a5d-5cde5ccd0b53 req-4c60817e-864e-47d5-9672-5337e646e791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee88d756-5674-4fae-a650-a006454697e6", "name": "network-vif-plugged", "status": "completed", "tag": "63945f38-3e20-498c-9928-cc55b45b7533"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:49.915882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:49.915882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:49.924558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-9b0e50aa-b7f2-4609-8a5d-5cde5ccd0b53 req-4c60817e-864e-47d5-9672-5337e646e791 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:49.924991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-9b0e50aa-b7f2-4609-8a5d-5cde5ccd0b53 req-4c60817e-864e-47d5-9672-5337e646e791 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:49.936548 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-9b0e50aa-b7f2-4609-8a5d-5cde5ccd0b53 req-4c60817e-864e-47d5-9672-5337e646e791 service nova] Creating event network-vif-plugged:63945f38-3e20-498c-9928-cc55b45b7533 for instance ee88d756-5674-4fae-a650-a006454697e6 on hv-cinder-78956 Aug 04 16:24:49.941831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-9b0e50aa-b7f2-4609-8a5d-5cde5ccd0b53 req-4c60817e-864e-47d5-9672-5337e646e791 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031982 Aug 04 16:24:49.942712 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 85/168] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:50.064795 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:50.065827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:50.073597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:50.074190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:50.074988 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:50.075602 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:50.222132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:50.229737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f4d66448-65b4-4358-85ae-444b2b0f7bfa tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.170275 Aug 04 16:24:50.230376 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 84/169] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:50 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:50.403921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:50.404613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:50.411047 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:50.411488 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:50.412258 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:50.412662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:50.752522 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:50.761129 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a3d3fad5-41d9-43c5-9828-3d1334075bf9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.361118 Aug 04 16:24:50.770407 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 86/170] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:50 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:51.247092 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:51.247710 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:51.254903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f3bcd90b-e76f-4fec-ae2a-30f6d7fecfd7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:51.255801 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f3bcd90b-e76f-4fec-ae2a-30f6d7fecfd7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:51.264160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3bcd90b-e76f-4fec-ae2a-30f6d7fecfd7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:51.266257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:51.266934 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3bcd90b-e76f-4fec-ae2a-30f6d7fecfd7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:51.267910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3bcd90b-e76f-4fec-ae2a-30f6d7fecfd7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:51.268545 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:51.269328 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:51.269757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:51.272934 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3bcd90b-e76f-4fec-ae2a-30f6d7fecfd7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:51.430074 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:51.438324 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-82642086-3495-4fa3-8014-a6c6c022badd tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.194799 Aug 04 16:24:51.438918 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 85/171] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:51 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:51.443351 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-f27e5da7-ddcb-48a6-bba0-df2bc6d99d86 req-b5b075e0-a625-457c-aa93-36bff560d8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e525871-8d1f-4462-9cb5-7e3aeb9c3977", "tag": "0da0ab28-3f37-48ae-94a1-42c44e08a854"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:51.444924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:51.444924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:24:51.454080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-f27e5da7-ddcb-48a6-bba0-df2bc6d99d86 req-b5b075e0-a625-457c-aa93-36bff560d8c5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:51.454520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-f27e5da7-ddcb-48a6-bba0-df2bc6d99d86 req-b5b075e0-a625-457c-aa93-36bff560d8c5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:51.466504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-f27e5da7-ddcb-48a6-bba0-df2bc6d99d86 req-b5b075e0-a625-457c-aa93-36bff560d8c5 service nova] Creating event network-changed:0da0ab28-3f37-48ae-94a1-42c44e08a854 for instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 on hv-cinder-78956 Aug 04 16:24:51.472520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-f27e5da7-ddcb-48a6-bba0-df2bc6d99d86 req-b5b075e0-a625-457c-aa93-36bff560d8c5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032424 Aug 04 16:24:51.473135 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 86/172] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:51.781787 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:51.782579 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:51.788875 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:51.790285 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:51.791061 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:51.791489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:51.970824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:51.997907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e82a490c-7a95-40b7-971f-07fb58bc358d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.216163 Aug 04 16:24:52.013556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 87/173] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:51 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:52.455094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:52.455724 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:52.463535 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:52.463982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:52.464763 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:52.465215 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:52.710999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:52.721002 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-560c3058-15ca-48fd-a2bc-54391388864d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.269358 Aug 04 16:24:52.721598 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 88/174] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:52 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:53.023532 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:53.024228 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:53.030739 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:53.031205 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:53.031994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:53.032410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:53.155423 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:53.162866 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-81c3e640-eb5d-40e9-826e-36b5ae8562a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.144658 Aug 04 16:24:53.163446 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 89/175] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:53 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:53.738997 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:53.738997 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:53.746134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:53.746527 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:53.747311 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:53.747741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:53.889800 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:53.897642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-abf678bf-b863-4e41-94c4-fd9fab85a58f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.163517 Aug 04 16:24:53.898254 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 90/176] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:53 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:54.178981 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:54.179559 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:54.185429 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:54.185878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:54.186680 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:54.187174 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:54.286993 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f3bcd90b-e76f-4fec-ae2a-30f6d7fecfd7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 3.035637 Aug 04 16:24:54.288159 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 87/177] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:24:51 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 3038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:54.457512 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:54.468674 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-10a55541-46be-4430-abf1-6d9e64c8b12c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.292595 Aug 04 16:24:54.475584 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 91/178] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:54 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:54.918589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:54.922403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:54.933373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:54.935152 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:54.936936 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:54.937708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:55.096950 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:55.104927 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3236d7ea-545f-43f5-ac1d-ed4d1081cffc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.192091 Aug 04 16:24:55.115697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 88/179] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:54 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:55.299200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6e9dac4f-3909-4fc9-914a-1af06d7a00ee tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:55.300830 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6e9dac4f-3909-4fc9-914a-1af06d7a00ee tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:55.309067 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e9dac4f-3909-4fc9-914a-1af06d7a00ee tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:55.309847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e9dac4f-3909-4fc9-914a-1af06d7a00ee tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:55.311200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e9dac4f-3909-4fc9-914a-1af06d7a00ee tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:55.311999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e9dac4f-3909-4fc9-914a-1af06d7a00ee tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:55.450669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6e9dac4f-3909-4fc9-914a-1af06d7a00ee tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.155385 Aug 04 16:24:55.451706 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 92/180] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:24:55 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:55.493233 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:55.494725 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:55.502265 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:55.502798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:55.503807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:55.504439 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:55.679372 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:55.687779 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-266d646a-4c3f-4b2d-92df-68a222d3b94e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1363 microversion: 2.1 time: 0.205737 Aug 04 16:24:55.702670 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 89/181] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:55 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:56.126497 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:56.127369 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:56.137189 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.137854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:56.138762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.139692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:56.308787 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:56.317914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7686fd2f-7559-4c9d-8e4c-21515d09dcbb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.197550 Aug 04 16:24:56.328712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 93/182] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:56 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:56.464791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-979fd998-22dc-4ce9-8e39-d553ab05bf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:56.466495 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-979fd998-22dc-4ce9-8e39-d553ab05bf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:56.475714 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-979fd998-22dc-4ce9-8e39-d553ab05bf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.476373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-979fd998-22dc-4ce9-8e39-d553ab05bf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:56.477263 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-979fd998-22dc-4ce9-8e39-d553ab05bf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.477791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-979fd998-22dc-4ce9-8e39-d553ab05bf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:56.565048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-979fd998-22dc-4ce9-8e39-d553ab05bf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.106306 Aug 04 16:24:56.565857 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 90/183] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:24:56 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:56.708867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:56.709486 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:56.719672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.719672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:56.719672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.719672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:56.907925 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:56.934322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ec1ff4de-4a1d-42de-9f88-9539408b8437 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1548 microversion: 2.1 time: 0.223983 Aug 04 16:24:56.955278 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7710b2d5-7af7-434f-a67b-e090c6959710 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:56.956560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7710b2d5-7af7-434f-a67b-e090c6959710 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:56.960922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 94/184] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:56 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1548 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:56.964342 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7710b2d5-7af7-434f-a67b-e090c6959710 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.964785 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7710b2d5-7af7-434f-a67b-e090c6959710 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:56.966240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7710b2d5-7af7-434f-a67b-e090c6959710 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:56.966801 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7710b2d5-7af7-434f-a67b-e090c6959710 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:57.310288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7710b2d5-7af7-434f-a67b-e090c6959710 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.361189 Aug 04 16:24:57.310997 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 91/185] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 4 16:24:56 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:57.338580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:57.340260 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:57.349008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:57.350423 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:57.352284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:57.353155 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:57.579457 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-85c4c994-0f38-44f4-9e9e-22c731e86b1f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:57.581334 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-85c4c994-0f38-44f4-9e9e-22c731e86b1f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:57.591214 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85c4c994-0f38-44f4-9e9e-22c731e86b1f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:57.591916 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85c4c994-0f38-44f4-9e9e-22c731e86b1f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:57.593911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85c4c994-0f38-44f4-9e9e-22c731e86b1f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:57.594974 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85c4c994-0f38-44f4-9e9e-22c731e86b1f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:57.704427 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-85c4c994-0f38-44f4-9e9e-22c731e86b1f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.130966 Aug 04 16:24:57.707702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 92/186] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:24:57 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:57.938558 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:57.955441 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6bd90bda-3b29-408e-b58d-861003338b41 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.622958 Aug 04 16:24:57.956449 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 95/187] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:57 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:58.254257 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2000121046", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "adba0a6e-44f8-4a54-84d5-54ff0bc6bb41"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:58.332888 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] validate_networks() for [('adba0a6e-44f8-4a54-84d5-54ff0bc6bb41', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:24:58.719738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b0f82774-1c06-433a-a6ff-a8ba25ec9ee7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:58.720751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b0f82774-1c06-433a-a6ff-a8ba25ec9ee7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:58.739222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0f82774-1c06-433a-a6ff-a8ba25ec9ee7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:58.740034 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0f82774-1c06-433a-a6ff-a8ba25ec9ee7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:58.741199 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0f82774-1c06-433a-a6ff-a8ba25ec9ee7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:58.741641 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0f82774-1c06-433a-a6ff-a8ba25ec9ee7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:58.820192 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:24:58.820707 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:24:58.821240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:24:58.821645 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:24:58.822132 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:24:58.833814 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:58.834207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:58.835374 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:58.836018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:58.853847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b0f82774-1c06-433a-a6ff-a8ba25ec9ee7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.141616 Aug 04 16:24:58.854523 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 96/188] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:24:58 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:58.862941 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:24:58.867874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for user b72fafb88f9f430ca1e561be656dda0f and project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:24:58.881649 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:24:58.884726 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:24:58.954972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f8d266af-baaf-4bac-98e0-fb978d679108 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705296 Aug 04 16:24:58.957044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 93/189] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:24:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:24:58.968525 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d82b47f6-b5f8-49ec-b66a-d980e78bd281 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:58.969658 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d82b47f6-b5f8-49ec-b66a-d980e78bd281 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:58.984805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:58.999835 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:59.030286 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:59.031175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:59.032167 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:59.032771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:59.126088 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d82b47f6-b5f8-49ec-b66a-d980e78bd281 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:59.134226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d82b47f6-b5f8-49ec-b66a-d980e78bd281 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1218 microversion: 2.1 time: 0.170293 Aug 04 16:24:59.134911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 97/190] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:58 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:59.273626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d5a0bac3-66ca-4703-b1cc-5d469aa0859d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:59.274556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d5a0bac3-66ca-4703-b1cc-5d469aa0859d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:59.291789 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:24:59.293763 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d5a0bac3-66ca-4703-b1cc-5d469aa0859d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:59.295468 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d5a0bac3-66ca-4703-b1cc-5d469aa0859d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:59.296569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d5a0bac3-66ca-4703-b1cc-5d469aa0859d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:59.297517 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d5a0bac3-66ca-4703-b1cc-5d469aa0859d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:59.314688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ad14697e-c5fe-4b1a-8829-fde03562e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.337955 Aug 04 16:24:59.318614 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 94/191] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:24:58 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:24:59.326889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-4a1f1200-2c0f-475f-8574-1c75d7c19ef5 req-d7e5ac97-9aa5-4093-a5c1-72569a02a007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee88d756-5674-4fae-a650-a006454697e6", "tag": "63945f38-3e20-498c-9928-cc55b45b7533"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:59.337264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:24:59.337264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:24:59.383618 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-4a1f1200-2c0f-475f-8574-1c75d7c19ef5 req-d7e5ac97-9aa5-4093-a5c1-72569a02a007 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:59.384198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-4a1f1200-2c0f-475f-8574-1c75d7c19ef5 req-d7e5ac97-9aa5-4093-a5c1-72569a02a007 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:59.403641 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d5a0bac3-66ca-4703-b1cc-5d469aa0859d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.134347 Aug 04 16:24:59.404672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 98/192] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:24:59 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:24:59.429105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-4a1f1200-2c0f-475f-8574-1c75d7c19ef5 req-d7e5ac97-9aa5-4093-a5c1-72569a02a007 service nova] Creating event network-changed:63945f38-3e20-498c-9928-cc55b45b7533 for instance ee88d756-5674-4fae-a650-a006454697e6 on hv-cinder-78956 Aug 04 16:24:59.439911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-4a1f1200-2c0f-475f-8574-1c75d7c19ef5 req-d7e5ac97-9aa5-4093-a5c1-72569a02a007 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119305 Aug 04 16:24:59.440974 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 95/193] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:59.865978 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-510986dc-5325-4071-83d7-e7b932113056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:59.867395 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-510986dc-5325-4071-83d7-e7b932113056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:24:59.897238 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-510986dc-5325-4071-83d7-e7b932113056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:59.897597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-510986dc-5325-4071-83d7-e7b932113056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:24:59.898409 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-510986dc-5325-4071-83d7-e7b932113056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:24:59.901018 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-510986dc-5325-4071-83d7-e7b932113056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:00.054575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-510986dc-5325-4071-83d7-e7b932113056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.192659 Aug 04 16:25:00.055740 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 99/194] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:24:59 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:00.153552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:00.154755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:00.175773 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:00.176215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:00.177066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:00.177489 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:00.246455 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:00.255684 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-97dfbc37-ffab-4dcb-acfd-9739ccad149f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1270 microversion: 2.1 time: 0.108094 Aug 04 16:25:00.256786 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 96/195] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:00 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:00.337933 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:00.338858 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:00.351537 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:00.352273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:00.353265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:00.353823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:00.417096 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-73272fe2-ef0f-43c9-abba-582c9495051f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:00.418310 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-73272fe2-ef0f-43c9-abba-582c9495051f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:00.429334 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-73272fe2-ef0f-43c9-abba-582c9495051f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:00.430470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-73272fe2-ef0f-43c9-abba-582c9495051f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:00.432568 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-73272fe2-ef0f-43c9-abba-582c9495051f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:00.434153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-73272fe2-ef0f-43c9-abba-582c9495051f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:00.559289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:00.560096 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-73272fe2-ef0f-43c9-abba-582c9495051f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.146787 Aug 04 16:25:00.560985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 97/196] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:00 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:25:00.572989 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-56f61235-3947-433f-9e37-155e6cdc7eab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.240378 Aug 04 16:25:00.577136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 100/197] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:00 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:01.066350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e45fa2ce-d67a-4192-a65a-65637903e848 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:01.067731 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e45fa2ce-d67a-4192-a65a-65637903e848 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:01.077842 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e45fa2ce-d67a-4192-a65a-65637903e848 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.078464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e45fa2ce-d67a-4192-a65a-65637903e848 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.079265 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e45fa2ce-d67a-4192-a65a-65637903e848 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.079685 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e45fa2ce-d67a-4192-a65a-65637903e848 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.209390 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e45fa2ce-d67a-4192-a65a-65637903e848 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.147109 Aug 04 16:25:01.210829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 98/198] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:01 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:01.280933 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:01.281547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:01.293563 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.298631 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.299581 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.300537 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.379293 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:01.388330 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-92be4bab-3da3-4e1f-a854-0a27f0571827 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1276 microversion: 2.1 time: 0.115681 Aug 04 16:25:01.395056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 101/199] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:01 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:01.572173 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f04a9cb1-d5c3-41df-a444-df8eb7b74cfe tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:01.573166 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f04a9cb1-d5c3-41df-a444-df8eb7b74cfe tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:01.580419 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f04a9cb1-d5c3-41df-a444-df8eb7b74cfe tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.580864 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f04a9cb1-d5c3-41df-a444-df8eb7b74cfe tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.581809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f04a9cb1-d5c3-41df-a444-df8eb7b74cfe tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.582281 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f04a9cb1-d5c3-41df-a444-df8eb7b74cfe tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.596848 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:01.597757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:01.608796 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.609747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.610698 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:01.611202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:01.705582 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f04a9cb1-d5c3-41df-a444-df8eb7b74cfe tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.137277 Aug 04 16:25:01.708737 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 99/200] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:01 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:01.839418 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:01.849118 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d6496d8c-d3c9-4e06-bb5b-ae8ad89ca4f7 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.257808 Aug 04 16:25:01.852263 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 102/201] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:01 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:02.220831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-87b587d9-ff79-46a1-ac71-e6b5e0ffcd70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:02.222481 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-87b587d9-ff79-46a1-ac71-e6b5e0ffcd70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:02.228972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87b587d9-ff79-46a1-ac71-e6b5e0ffcd70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.232886 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87b587d9-ff79-46a1-ac71-e6b5e0ffcd70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:02.233836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87b587d9-ff79-46a1-ac71-e6b5e0ffcd70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.234323 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87b587d9-ff79-46a1-ac71-e6b5e0ffcd70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:02.341275 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-87b587d9-ff79-46a1-ac71-e6b5e0ffcd70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.124657 Aug 04 16:25:02.342243 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 100/202] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:02 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:02.407403 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:02.408588 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:02.416662 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.417269 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:02.418325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.418905 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:02.718013 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d98707ad-7fb9-4bcf-9b5d-a466a9dbf0cf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:02.719553 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d98707ad-7fb9-4bcf-9b5d-a466a9dbf0cf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:02.731948 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d98707ad-7fb9-4bcf-9b5d-a466a9dbf0cf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.733091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d98707ad-7fb9-4bcf-9b5d-a466a9dbf0cf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:02.735804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d98707ad-7fb9-4bcf-9b5d-a466a9dbf0cf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.736860 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d98707ad-7fb9-4bcf-9b5d-a466a9dbf0cf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:02.912918 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d98707ad-7fb9-4bcf-9b5d-a466a9dbf0cf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.198548 Aug 04 16:25:02.913991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 101/203] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:02 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:02.927338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:02.928594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:02.939782 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:02.949267 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-37b4855f-51b3-4783-a381-24291ab27ff7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.546360 Aug 04 16:25:02.949569 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.950362 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:02.952154 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 103/204] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:02 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:02.962919 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:02.964080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:03.098634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-0d10bd89-28b3-4d4d-884b-386cc161320d req-d5a5aaff-fad7-4fc8-9972-0ade0e4b8d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab28e453-d982-46f7-b51d-19d0a91ccfea", "tag": "a3e775d0-e69d-4c40-9188-fbe388517260"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:03.101332 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:25:03.101332 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:25:03.111339 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-0d10bd89-28b3-4d4d-884b-386cc161320d req-d5a5aaff-fad7-4fc8-9972-0ade0e4b8d7d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:03.112035 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-0d10bd89-28b3-4d4d-884b-386cc161320d req-d5a5aaff-fad7-4fc8-9972-0ade0e4b8d7d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:03.153424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-0d10bd89-28b3-4d4d-884b-386cc161320d req-d5a5aaff-fad7-4fc8-9972-0ade0e4b8d7d service nova] Creating event network-changed:a3e775d0-e69d-4c40-9188-fbe388517260 for instance ab28e453-d982-46f7-b51d-19d0a91ccfea on hv-cinder-78956 Aug 04 16:25:03.170220 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-0d10bd89-28b3-4d4d-884b-386cc161320d req-d5a5aaff-fad7-4fc8-9972-0ade0e4b8d7d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071095 Aug 04 16:25:03.173553 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 104/205] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:25:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:25:03.245692 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:03.260330 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-23ec4f4b-e5a0-49f7-a546-c1e34b6f0929 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.341587 Aug 04 16:25:03.270020 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 102/206] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:02 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:03.354791 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-88eaf1d2-8ce9-4f07-9361-0f88c84f290b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:03.355944 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-88eaf1d2-8ce9-4f07-9361-0f88c84f290b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:03.369256 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88eaf1d2-8ce9-4f07-9361-0f88c84f290b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:03.369841 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88eaf1d2-8ce9-4f07-9361-0f88c84f290b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:03.371504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88eaf1d2-8ce9-4f07-9361-0f88c84f290b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:03.372669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88eaf1d2-8ce9-4f07-9361-0f88c84f290b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:03.527561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-88eaf1d2-8ce9-4f07-9361-0f88c84f290b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.177634 Aug 04 16:25:03.531822 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 105/207] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:03 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:03.926552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d10899e8-b1a0-47f5-99d1-d590c2895b7b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:03.927476 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d10899e8-b1a0-47f5-99d1-d590c2895b7b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:03.934515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d10899e8-b1a0-47f5-99d1-d590c2895b7b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:03.934942 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d10899e8-b1a0-47f5-99d1-d590c2895b7b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:03.935987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d10899e8-b1a0-47f5-99d1-d590c2895b7b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:03.936661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d10899e8-b1a0-47f5-99d1-d590c2895b7b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:03.982536 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:03.983327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:03.990459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:03.990883 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:03.991640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:03.992063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:04.064450 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d10899e8-b1a0-47f5-99d1-d590c2895b7b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.141255 Aug 04 16:25:04.065374 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 103/208] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:03 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:04.219438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:04.226818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d8b231fa-1b07-4172-a089-afc17ecc5a2c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.248178 Aug 04 16:25:04.227260 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 106/209] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:03 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:04.281028 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:04.282440 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:04.289940 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:04.290554 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:04.291367 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:04.291801 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:04.441250 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:04.451085 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9cab5c1f-2c6e-4454-a141-de07a21cd653 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.175730 Aug 04 16:25:04.452253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 104/210] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:04 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:04.540111 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e37711a3-1ab7-4b4c-ae45-bece27d38c7f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:04.541824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e37711a3-1ab7-4b4c-ae45-bece27d38c7f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:04.549601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e37711a3-1ab7-4b4c-ae45-bece27d38c7f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:04.550065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e37711a3-1ab7-4b4c-ae45-bece27d38c7f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:04.550891 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e37711a3-1ab7-4b4c-ae45-bece27d38c7f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:04.551325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e37711a3-1ab7-4b4c-ae45-bece27d38c7f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:04.657044 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e37711a3-1ab7-4b4c-ae45-bece27d38c7f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.120667 Aug 04 16:25:04.661979 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 107/211] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:04 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:05.075531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d285b7ec-fd40-40a1-8b80-88a95bc3aee3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:05.076716 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d285b7ec-fd40-40a1-8b80-88a95bc3aee3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:05.084910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d285b7ec-fd40-40a1-8b80-88a95bc3aee3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.085558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d285b7ec-fd40-40a1-8b80-88a95bc3aee3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.086549 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d285b7ec-fd40-40a1-8b80-88a95bc3aee3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.087187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d285b7ec-fd40-40a1-8b80-88a95bc3aee3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.217210 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d285b7ec-fd40-40a1-8b80-88a95bc3aee3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.145161 Aug 04 16:25:05.218002 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 105/212] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:05 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:05.245776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:05.248202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:05.280033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.281768 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.284513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.285154 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.300729 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:05.302199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:05.317304 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.325502 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.326595 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.327171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.385638 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:25:05.505242 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-595b2855-f902-47d9-8600-caaf8d329484 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "DELETE /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 204 len: 0 microversion: 2.1 time: 0.209435 Aug 04 16:25:05.506473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 106/213] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:25:05 2021] DELETE /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:25:05.512025 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:05.512751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:05.519858 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.520627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.521574 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.522108 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.586380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:05.598257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3107f2dc-24bd-4237-84d4-84d5a73b116c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.357867 Aug 04 16:25:05.599326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 108/214] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:05 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:05.604356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:05.605056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:05.617190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.617604 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.620092 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.620764 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.701084 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:05.716148 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b7bd6264-90e5-486a-b297-20a73457d2d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.208307 Aug 04 16:25:05.717180 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 107/215] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:05 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:05.739525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bd1638dc-527c-4a90-a637-cda7e02e967f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:05.740813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-bd1638dc-527c-4a90-a637-cda7e02e967f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:05.754517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd1638dc-527c-4a90-a637-cda7e02e967f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.755770 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd1638dc-527c-4a90-a637-cda7e02e967f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.759301 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd1638dc-527c-4a90-a637-cda7e02e967f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:05.759855 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd1638dc-527c-4a90-a637-cda7e02e967f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:05.855731 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:05.864705 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3ba1ff7b-8910-4215-9ae5-510de556e4b1 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1551 microversion: 2.1 time: 0.263887 Aug 04 16:25:05.865297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 109/216] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:05 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1551 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:05.886813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-bd1638dc-527c-4a90-a637-cda7e02e967f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.167672 Aug 04 16:25:05.891971 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 108/217] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:05 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:06.228330 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3eaecf36-8ea2-46e1-8a47-765af1fe2ded tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:06.229251 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3eaecf36-8ea2-46e1-8a47-765af1fe2ded tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:06.235941 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3eaecf36-8ea2-46e1-8a47-765af1fe2ded tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.236727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3eaecf36-8ea2-46e1-8a47-765af1fe2ded tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.237581 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3eaecf36-8ea2-46e1-8a47-765af1fe2ded tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.238123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3eaecf36-8ea2-46e1-8a47-765af1fe2ded tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.354203 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3eaecf36-8ea2-46e1-8a47-765af1fe2ded tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.129297 Aug 04 16:25:06.354803 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 110/218] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:06 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:06.617872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:06.618594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:06.626087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.626833 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.627606 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.628029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.736130 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:06.737312 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:06.744764 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.746068 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.747513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.748194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.775959 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:06.784219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d9cf64f7-164b-446f-84a7-88995a9c0fb5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.170911 Aug 04 16:25:06.786673 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 109/219] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:06 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:06.882722 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:06.883463 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:06.892678 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.893417 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.894497 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.895174 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.928816 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:06.938986 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-496a48d9-340e-49aa-a568-6af929635d0e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.205080 Aug 04 16:25:06.938986 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 111/220] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:06 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:06.951579 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e1f6499d-19cc-4cab-a306-a2a2142d927f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:06.953097 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e1f6499d-19cc-4cab-a306-a2a2142d927f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:06.960400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1f6499d-19cc-4cab-a306-a2a2142d927f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.961143 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1f6499d-19cc-4cab-a306-a2a2142d927f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:06.962346 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1f6499d-19cc-4cab-a306-a2a2142d927f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:06.963628 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1f6499d-19cc-4cab-a306-a2a2142d927f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:07.051331 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:07.059723 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f8dff81f-3448-4c84-b2ae-804b226cbd13 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1551 microversion: 2.1 time: 0.181527 Aug 04 16:25:07.060673 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 110/221] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:06 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1551 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:07.071565 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e1f6499d-19cc-4cab-a306-a2a2142d927f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.133144 Aug 04 16:25:07.072664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 112/222] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:06 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:07.366455 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1143d673-cd93-4d1d-8aff-a7b30a9918dd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:07.367867 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1143d673-cd93-4d1d-8aff-a7b30a9918dd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:07.377643 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1143d673-cd93-4d1d-8aff-a7b30a9918dd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:07.379195 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1143d673-cd93-4d1d-8aff-a7b30a9918dd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:07.379975 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1143d673-cd93-4d1d-8aff-a7b30a9918dd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:07.380544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1143d673-cd93-4d1d-8aff-a7b30a9918dd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:07.488508 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1143d673-cd93-4d1d-8aff-a7b30a9918dd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.125856 Aug 04 16:25:07.489161 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 111/223] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:07 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:07.810482 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:07.811833 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:07.827895 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:07.828703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:07.830653 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:07.832846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:07.953905 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:07.954846 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:07.967534 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:07.968374 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:07.969642 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:07.971343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:08.069070 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:08.077730 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-49d2ce55-8be4-4887-9f7f-7ad07f6fb75b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.278636 Aug 04 16:25:08.078812 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 113/224] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:07 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:08.086301 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f15acb12-13c6-4b5a-9f4f-22214478b112 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:08.087641 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f15acb12-13c6-4b5a-9f4f-22214478b112 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:08.094764 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15acb12-13c6-4b5a-9f4f-22214478b112 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:08.095614 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15acb12-13c6-4b5a-9f4f-22214478b112 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:08.096727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15acb12-13c6-4b5a-9f4f-22214478b112 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:08.097401 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15acb12-13c6-4b5a-9f4f-22214478b112 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:08.187614 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:08.195387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cbe26163-d1e0-4c7b-8820-2cf9fb5c59d0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.246146 Aug 04 16:25:08.211674 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 112/225] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:07 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:08.212201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f15acb12-13c6-4b5a-9f4f-22214478b112 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.130423 Aug 04 16:25:08.216356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 114/226] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:08 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:08.219587 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:08.220404 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:08.227179 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:08.227704 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:08.228556 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:08.228978 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:08.396874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:08.408276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6d0bbfbd-86ef-4214-8e44-69bebcfb5287 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1551 microversion: 2.1 time: 0.194773 Aug 04 16:25:08.418654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 113/227] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:08 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1551 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:08.501985 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-897438fe-012a-4d36-a43f-21082cc776ec tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:08.503001 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-897438fe-012a-4d36-a43f-21082cc776ec tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:08.510284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-897438fe-012a-4d36-a43f-21082cc776ec tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:08.511013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-897438fe-012a-4d36-a43f-21082cc776ec tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:08.512060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-897438fe-012a-4d36-a43f-21082cc776ec tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:08.512639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-897438fe-012a-4d36-a43f-21082cc776ec tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:08.687810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-897438fe-012a-4d36-a43f-21082cc776ec tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.190729 Aug 04 16:25:08.688590 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 115/228] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:08 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:09.097051 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:09.097634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:09.104707 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.105223 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.106191 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.106696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.220101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:09.221543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:09.232269 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.232720 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.233608 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.234178 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.258976 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:09.267477 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b252da45-602f-4d50-8ced-a7343ca472fb tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.174936 Aug 04 16:25:09.268391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 114/229] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:09 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:09.273390 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-23f00f63-9436-4135-8afd-0ba8b6588135 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:09.274760 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-23f00f63-9436-4135-8afd-0ba8b6588135 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:09.282877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23f00f63-9436-4135-8afd-0ba8b6588135 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.283502 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23f00f63-9436-4135-8afd-0ba8b6588135 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.285022 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23f00f63-9436-4135-8afd-0ba8b6588135 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.285022 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-23f00f63-9436-4135-8afd-0ba8b6588135 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.395422 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-23f00f63-9436-4135-8afd-0ba8b6588135 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.125571 Aug 04 16:25:09.396420 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 115/230] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:09 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:09.426561 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:09.427583 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:09.434732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.435238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.436016 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.436467 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.509448 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:09.520004 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0e6e620e-5f42-41b6-8c6c-3879d6e52d10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.307547 Aug 04 16:25:09.520693 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 116/231] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:09 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:09.600340 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:09.610749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-76516263-0405-4abc-a1ef-f043641ddc43 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1551 microversion: 2.1 time: 0.189338 Aug 04 16:25:09.611341 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 116/232] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:09 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1551 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:09.699794 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0655b3d3-105a-4d8b-bc7d-fa2e7f674b1f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:09.700837 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0655b3d3-105a-4d8b-bc7d-fa2e7f674b1f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:09.707822 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0655b3d3-105a-4d8b-bc7d-fa2e7f674b1f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.708367 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0655b3d3-105a-4d8b-bc7d-fa2e7f674b1f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.709349 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0655b3d3-105a-4d8b-bc7d-fa2e7f674b1f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.710172 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0655b3d3-105a-4d8b-bc7d-fa2e7f674b1f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.825783 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0655b3d3-105a-4d8b-bc7d-fa2e7f674b1f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.130082 Aug 04 16:25:09.826830 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 117/233] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:09 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:09.926176 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-447c186f-8424-4402-b822-ac81ceafb26c req-fa5ef7dc-bad1-4f7f-be39-807892d542e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcb6970-bf7c-4e02-b6ed-b546eb86143a", "name": "network-vif-deleted", "tag": "b924c080-25ef-46de-a092-6a7839885e48"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:09.928406 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:25:09.928406 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:25:09.937517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-447c186f-8424-4402-b822-ac81ceafb26c req-fa5ef7dc-bad1-4f7f-be39-807892d542e9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:09.938088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-447c186f-8424-4402-b822-ac81ceafb26c req-fa5ef7dc-bad1-4f7f-be39-807892d542e9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:09.951821 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-447c186f-8424-4402-b822-ac81ceafb26c req-fa5ef7dc-bad1-4f7f-be39-807892d542e9 service nova] Creating event network-vif-deleted:b924c080-25ef-46de-a092-6a7839885e48 for instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a on hv-cinder-78956 Aug 04 16:25:09.957926 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-447c186f-8424-4402-b822-ac81ceafb26c req-fa5ef7dc-bad1-4f7f-be39-807892d542e9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035650 Aug 04 16:25:09.958514 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 117/234] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:25:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:25:10.286948 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:10.287729 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:10.294639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.295079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.295945 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.296538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.410343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-33c17b05-8689-4da7-a65a-ac6e6d69f226 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:10.411356 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-33c17b05-8689-4da7-a65a-ac6e6d69f226 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:10.417766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-33c17b05-8689-4da7-a65a-ac6e6d69f226 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.418172 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-33c17b05-8689-4da7-a65a-ac6e6d69f226 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.418976 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-33c17b05-8689-4da7-a65a-ac6e6d69f226 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.419415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-33c17b05-8689-4da7-a65a-ac6e6d69f226 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.462322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:10.471831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8887b3b6-f248-44fb-aea4-11d3319505cc tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.188866 Aug 04 16:25:10.472564 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 118/235] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:10 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:10.538699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-33c17b05-8689-4da7-a65a-ac6e6d69f226 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.133450 Aug 04 16:25:10.542466 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 118/236] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:10 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:10.542605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:10.542605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:10.549450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.549905 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.550930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.551461 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.629774 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:10.630532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:10.641097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.641541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.643032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.643484 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.729833 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df66070b00d74211a323ea8de3f39a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850dad1624c4086936f0a56a723b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:10.741098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b0731e76-5c71-413c-875e-30f12c4013ef tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 200 len: 1344 microversion: 2.1 time: 0.116012 Aug 04 16:25:10.741685 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 119/237] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:10 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 1344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:10.751584 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:10.755109 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-244ed264-22da-4180-960f-8c42a194ffe2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.217115 Aug 04 16:25:10.755779 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 119/238] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:10 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:10.841207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-11d14371-4e41-4185-971c-9e78f162f588 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:10.842365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-11d14371-4e41-4185-971c-9e78f162f588 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:10.850350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11d14371-4e41-4185-971c-9e78f162f588 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.850897 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11d14371-4e41-4185-971c-9e78f162f588 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.851760 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11d14371-4e41-4185-971c-9e78f162f588 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:10.852379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11d14371-4e41-4185-971c-9e78f162f588 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:10.945200 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-11d14371-4e41-4185-971c-9e78f162f588 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.111602 Aug 04 16:25:10.946524 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 120/239] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:10 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:11.496086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:11.497255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:11.507803 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.513065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.513065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.513065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.555843 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a4888543-576a-442d-9236-82dce6b99bb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:11.557276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a4888543-576a-442d-9236-82dce6b99bb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:11.571517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4888543-576a-442d-9236-82dce6b99bb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.572051 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4888543-576a-442d-9236-82dce6b99bb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.573007 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4888543-576a-442d-9236-82dce6b99bb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.573435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4888543-576a-442d-9236-82dce6b99bb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.678004 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a4888543-576a-442d-9236-82dce6b99bb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.128244 Aug 04 16:25:11.678939 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 121/240] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:11 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:11.761567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:11.762757 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:11.775767 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.776236 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.777060 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.781758 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.805389 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] HTTP exception thrown: Instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a could not be found. Aug 04 16:25:11.806449 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Returning 404 to user: Instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:25:11.807445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-46006a5c-fe82-4cb8-9dae-d15a2b868e49 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 404 len: 111 microversion: 2.1 time: 0.052020 Aug 04 16:25:11.808284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 122/241] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:11 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:25:11.821330 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:11.821923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:11.831461 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:11.839774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-71d32453-e080-453c-ba8c-510810848a80 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.352735 Aug 04 16:25:11.844916 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 120/242] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:11 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:11.851235 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.854274 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.856738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.859073 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.958091 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0c09c2db-d05c-495c-a2e1-c1913c56ea79 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:11.959335 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0c09c2db-d05c-495c-a2e1-c1913c56ea79 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:11.971172 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c09c2db-d05c-495c-a2e1-c1913c56ea79 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.973436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c09c2db-d05c-495c-a2e1-c1913c56ea79 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:11.979057 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c09c2db-d05c-495c-a2e1-c1913c56ea79 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:11.980324 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c09c2db-d05c-495c-a2e1-c1913c56ea79 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:12.151901 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0c09c2db-d05c-495c-a2e1-c1913c56ea79 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.198460 Aug 04 16:25:12.152624 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 121/243] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:11 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:25:12.152916 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:12.162056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-8b33e300-7863-40b4-8d6f-c39d27eb0343 req-54fdb4cf-69c2-49bc-82e5-38b7d7e0ae04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab28e453-d982-46f7-b51d-19d0a91ccfea", "name": "network-vif-plugged", "status": "completed", "tag": "a3e775d0-e69d-4c40-9188-fbe388517260"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:12.164138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:25:12.164138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:25:12.178898 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-8b33e300-7863-40b4-8d6f-c39d27eb0343 req-54fdb4cf-69c2-49bc-82e5-38b7d7e0ae04 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:12.182615 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-8b33e300-7863-40b4-8d6f-c39d27eb0343 req-54fdb4cf-69c2-49bc-82e5-38b7d7e0ae04 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:12.191194 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4b96152c-be4c-4898-bd7b-8727afccba0d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.381385 Aug 04 16:25:12.200830 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 123/244] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:11 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:12.201242 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-8b33e300-7863-40b4-8d6f-c39d27eb0343 req-54fdb4cf-69c2-49bc-82e5-38b7d7e0ae04 service nova] Creating event network-vif-plugged:a3e775d0-e69d-4c40-9188-fbe388517260 for instance ab28e453-d982-46f7-b51d-19d0a91ccfea on hv-cinder-78956 Aug 04 16:25:12.208955 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-8b33e300-7863-40b4-8d6f-c39d27eb0343 req-54fdb4cf-69c2-49bc-82e5-38b7d7e0ae04 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051401 Aug 04 16:25:12.209875 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 122/245] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:25:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:25:12.691087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-620291fd-bf2d-4aeb-a56e-03faed9b8f49 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:12.693067 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-620291fd-bf2d-4aeb-a56e-03faed9b8f49 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:12.700895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-620291fd-bf2d-4aeb-a56e-03faed9b8f49 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:12.715067 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-620291fd-bf2d-4aeb-a56e-03faed9b8f49 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:12.717046 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-620291fd-bf2d-4aeb-a56e-03faed9b8f49 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:12.717897 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-620291fd-bf2d-4aeb-a56e-03faed9b8f49 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:12.844015 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-620291fd-bf2d-4aeb-a56e-03faed9b8f49 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 14 microversion: 2.20 time: 0.157097 Aug 04 16:25:12.845097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 124/246] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:12 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:12.861658 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:12.863014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:12.873676 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:12.874420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:12.878517 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:12.879169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.057294 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:13.065836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9715f391-8275-48d1-a45f-11954449eced tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.208709 Aug 04 16:25:13.066788 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 123/247] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:12 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:13.164060 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2d445a7d-3110-41f0-a987-49d9fe09b0b2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:13.165066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2d445a7d-3110-41f0-a987-49d9fe09b0b2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:13.171921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d445a7d-3110-41f0-a987-49d9fe09b0b2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.172642 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d445a7d-3110-41f0-a987-49d9fe09b0b2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.174008 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d445a7d-3110-41f0-a987-49d9fe09b0b2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.174629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d445a7d-3110-41f0-a987-49d9fe09b0b2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.208407 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:13.209044 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:13.225670 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.226483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.227620 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.228303 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.296778 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2d445a7d-3110-41f0-a987-49d9fe09b0b2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.136392 Aug 04 16:25:13.298114 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 125/248] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:13 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:13.364586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:13.365593 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:13.375479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.375964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.376868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.377562 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.394085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:13.404987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c7a4f336-1d16-459b-a47f-87bd41aed4f0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.200370 Aug 04 16:25:13.415376 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 124/249] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:13 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:13.417184 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] HTTP exception thrown: Instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a could not be found. Aug 04 16:25:13.417801 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Returning 404 to user: Instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:25:13.418689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4fe39275-05f5-4dd4-b9f5-941f9ac96c4d tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "DELETE /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 404 len: 111 microversion: 2.1 time: 0.058851 Aug 04 16:25:13.424151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 126/250] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:25:13 2021] DELETE /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:25:13.430089 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:13.430799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] [instance: 8fcb6970-bf7c-4e02-b6ed-b546eb86143a] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:13.437864 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.438359 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.439361 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.439806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.456577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] HTTP exception thrown: Instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a could not be found. Aug 04 16:25:13.457191 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] Returning 404 to user: Instance 8fcb6970-bf7c-4e02-b6ed-b546eb86143a could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:25:13.458084 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d70b90c0-5aee-42d8-b81f-ad87d5c390a2 tempest-DeleteServersTestJSON-2093615247 tempest-DeleteServersTestJSON-2093615247-project] 10.222.0.77 "GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a" status: 404 len: 111 microversion: 2.1 time: 0.032800 Aug 04 16:25:13.463702 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 125/251] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:13 2021] GET /compute/v2.1/servers/8fcb6970-bf7c-4e02-b6ed-b546eb86143a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:25:13.855952 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-06ffd01b-dff3-4bde-9110-7e3780c9c1d5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:13.856856 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-06ffd01b-dff3-4bde-9110-7e3780c9c1d5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:13.863344 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-06ffd01b-dff3-4bde-9110-7e3780c9c1d5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.863890 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-06ffd01b-dff3-4bde-9110-7e3780c9c1d5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.864752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-06ffd01b-dff3-4bde-9110-7e3780c9c1d5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:13.865251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-06ffd01b-dff3-4bde-9110-7e3780c9c1d5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:13.985472 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-06ffd01b-dff3-4bde-9110-7e3780c9c1d5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 1298 microversion: 2.20 time: 0.134018 Aug 04 16:25:13.986262 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 127/252] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:13 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:25:14.084126 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:14.085280 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:14.092844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:14.094160 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:14.095248 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:14.095769 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:14.300166 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:14.308803 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-03dccfe5-2e8f-49b2-ba12-311328316a7a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1318 microversion: 2.1 time: 0.229992 Aug 04 16:25:14.309776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 126/253] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:14 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:14.326411 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2166d5f4-9928-4248-9473-d36d03c0fc5f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:14.327785 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2166d5f4-9928-4248-9473-d36d03c0fc5f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:14.338739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2166d5f4-9928-4248-9473-d36d03c0fc5f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:14.339724 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2166d5f4-9928-4248-9473-d36d03c0fc5f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:14.340986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2166d5f4-9928-4248-9473-d36d03c0fc5f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:14.341891 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2166d5f4-9928-4248-9473-d36d03c0fc5f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:14.429459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:14.430200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:14.438627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2166d5f4-9928-4248-9473-d36d03c0fc5f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.132353 Aug 04 16:25:14.442293 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 128/254] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:14 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:25:14.442818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:14.443271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:14.444065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:14.444487 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:14.608535 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:14.618748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e5b9783b-4fc1-405e-a1ae-ec1faf50eaf2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.194227 Aug 04 16:25:14.619911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 127/255] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:14 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:14.997118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2c4d547d-53b9-4731-9145-a5aff388d72d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:14.998289 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2c4d547d-53b9-4731-9145-a5aff388d72d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:15.005730 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c4d547d-53b9-4731-9145-a5aff388d72d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.006205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c4d547d-53b9-4731-9145-a5aff388d72d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.007133 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c4d547d-53b9-4731-9145-a5aff388d72d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.007667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c4d547d-53b9-4731-9145-a5aff388d72d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.178446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2c4d547d-53b9-4731-9145-a5aff388d72d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 6451 microversion: 2.20 time: 0.185177 Aug 04 16:25:15.182142 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 129/256] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:14 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 6451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:25:15.331560 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:15.332269 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:15.338885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.339350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.340085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.340840 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.457069 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a6db36c1-b8dc-4a2b-ae1d-edeed1421b39 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:15.459018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a6db36c1-b8dc-4a2b-ae1d-edeed1421b39 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:15.471058 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6db36c1-b8dc-4a2b-ae1d-edeed1421b39 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.471846 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6db36c1-b8dc-4a2b-ae1d-edeed1421b39 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.474490 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6db36c1-b8dc-4a2b-ae1d-edeed1421b39 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.475205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6db36c1-b8dc-4a2b-ae1d-edeed1421b39 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.554267 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:15.562655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8175951c-6898-4a87-b640-64652ab8e1b4 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1509 microversion: 2.1 time: 0.235351 Aug 04 16:25:15.563233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 128/257] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:15 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:15.587877 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbb51ea9-50dc-4f17-acdd-11b374c91a8c"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:15.590273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:15.595347 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a6db36c1-b8dc-4a2b-ae1d-edeed1421b39 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.148757 Aug 04 16:25:15.601752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 130/258] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:15 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:25:15.608690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.610175 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.614089 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.614743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.642442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:15.644074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:15.656933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.656933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.657661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.658266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.746297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] HTTP exception thrown: Invalid volume: volume dbb51ea9-50dc-4f17-acdd-11b374c91a8c is already attached to instances: 3cb69746-5594-47c6-abfb-beffa84fb2ca Aug 04 16:25:15.746949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Returning 400 to user: Invalid volume: volume dbb51ea9-50dc-4f17-acdd-11b374c91a8c is already attached to instances: 3cb69746-5594-47c6-abfb-beffa84fb2ca {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:25:15.747795 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-879fd702-8955-4f3a-9049-ae6f08fc8998 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.168375 Aug 04 16:25:15.748369 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 129/259] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:25:15 2021] POST /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:25:15.833642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:15.834829 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:15.841161 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.841675 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.842862 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:15.843534 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:15.854619 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:15.866283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cffa5843-7102-4829-beb0-e9decc27ba09 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.230938 Aug 04 16:25:15.876535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 131/260] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:15 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:16.009965 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lazy-loading 'services' on Instance uuid 3cb69746-5594-47c6-abfb-beffa84fb2ca {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:25:16.155010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-da3524c7-3b16-4830-8a0c-7c72f9223fda tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "DELETE /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca/os-volume_attachments/dbb51ea9-50dc-4f17-acdd-11b374c91a8c" status: 202 len: 0 microversion: 2.1 time: 0.325383 Aug 04 16:25:16.156505 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 130/261] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:25:15 2021] DELETE /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca/os-volume_attachments/dbb51ea9-50dc-4f17-acdd-11b374c91a8c => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:16.200956 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-992584cf-6232-4fa2-8376-0fa7c0b3e0d9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:16.204626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-992584cf-6232-4fa2-8376-0fa7c0b3e0d9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:16.226313 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-992584cf-6232-4fa2-8376-0fa7c0b3e0d9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:16.226985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-992584cf-6232-4fa2-8376-0fa7c0b3e0d9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:16.227879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-992584cf-6232-4fa2-8376-0fa7c0b3e0d9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:16.228659 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-992584cf-6232-4fa2-8376-0fa7c0b3e0d9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:16.378454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-992584cf-6232-4fa2-8376-0fa7c0b3e0d9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 10159 microversion: 2.20 time: 0.193110 Aug 04 16:25:16.382734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 132/262] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:16 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 10159 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:16.611922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3a8bb337-5782-4a4c-aea3-c8850df5aaae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:16.613045 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3a8bb337-5782-4a4c-aea3-c8850df5aaae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:16.619471 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a8bb337-5782-4a4c-aea3-c8850df5aaae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:16.620098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a8bb337-5782-4a4c-aea3-c8850df5aaae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:16.621006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a8bb337-5782-4a4c-aea3-c8850df5aaae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:16.621640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a8bb337-5782-4a4c-aea3-c8850df5aaae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:16.711748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3a8bb337-5782-4a4c-aea3-c8850df5aaae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.105015 Aug 04 16:25:16.713038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 131/263] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:16 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:16.883968 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:16.884661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:16.891326 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:16.891766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:16.892632 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:16.893094 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:17.030372 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:17.039056 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1cbdf164-286e-472e-b77e-ccb82f5d07ff tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.158990 Aug 04 16:25:17.039807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 133/264] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:16 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:17.389895 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9e5b311d-3347-451e-abae-2956ac445f24 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:17.391109 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9e5b311d-3347-451e-abae-2956ac445f24 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:17.397930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9e5b311d-3347-451e-abae-2956ac445f24 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:17.398427 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9e5b311d-3347-451e-abae-2956ac445f24 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:17.399172 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9e5b311d-3347-451e-abae-2956ac445f24 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:17.399648 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9e5b311d-3347-451e-abae-2956ac445f24 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:17.480399 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9e5b311d-3347-451e-abae-2956ac445f24 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 12459 microversion: 2.20 time: 0.094504 Aug 04 16:25:17.481060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 132/265] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:17 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 12459 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:17.723373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f55ccd72-dfe4-4c4a-8cfd-ec167289df30 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:17.724270 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f55ccd72-dfe4-4c4a-8cfd-ec167289df30 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:17.730708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f55ccd72-dfe4-4c4a-8cfd-ec167289df30 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:17.731157 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f55ccd72-dfe4-4c4a-8cfd-ec167289df30 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:17.731927 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f55ccd72-dfe4-4c4a-8cfd-ec167289df30 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:17.732358 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f55ccd72-dfe4-4c4a-8cfd-ec167289df30 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:17.928523 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f55ccd72-dfe4-4c4a-8cfd-ec167289df30 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14 microversion: 2.1 time: 0.208711 Aug 04 16:25:17.929228 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 134/266] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:17 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:18.058116 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:18.058821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:18.066579 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:18.067094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:18.067943 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:18.068396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:18.241010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:18.248482 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9a1d1cff-f125-4227-ac6a-1ab4a4b1ef6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.194468 Aug 04 16:25:18.249265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 133/267] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:18 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:18.493596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3bdc61a0-4a3a-418d-b51a-c64baf749957 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:18.494626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3bdc61a0-4a3a-418d-b51a-c64baf749957 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:18.502199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bdc61a0-4a3a-418d-b51a-c64baf749957 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:18.502950 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bdc61a0-4a3a-418d-b51a-c64baf749957 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:18.504415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bdc61a0-4a3a-418d-b51a-c64baf749957 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:18.505003 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bdc61a0-4a3a-418d-b51a-c64baf749957 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:18.537110 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-707298419", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "adba0a6e-44f8-4a54-84d5-54ff0bc6bb41"}]}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:18.606634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] validate_networks() for [('adba0a6e-44f8-4a54-84d5-54ff0bc6bb41', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:25:18.643032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3bdc61a0-4a3a-418d-b51a-c64baf749957 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 15064 microversion: 2.20 time: 0.153512 Aug 04 16:25:18.643694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 135/268] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:18 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 15064 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:18.942512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-717fe6d6-c8cb-4286-884c-a7ec90f0dbdb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:18.943629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-717fe6d6-c8cb-4286-884c-a7ec90f0dbdb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:18.950558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-717fe6d6-c8cb-4286-884c-a7ec90f0dbdb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:18.951000 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-717fe6d6-c8cb-4286-884c-a7ec90f0dbdb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:18.951770 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-717fe6d6-c8cb-4286-884c-a7ec90f0dbdb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:18.952350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-717fe6d6-c8cb-4286-884c-a7ec90f0dbdb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:19.023400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:25:19.024051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:25:19.024864 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:25:19.025519 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:25:19.026262 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:25:19.036133 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:19.036569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:19.037363 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:19.037804 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:19.057517 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:25:19.061774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for user b72fafb88f9f430ca1e561be656dda0f and project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:25:19.073480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:25:19.075859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:25:19.122494 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-27c9acb8-974e-426c-9239-aa525196a4d6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588974 Aug 04 16:25:19.123132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 134/269] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:25:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:25:19.132996 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ce5cdc58-b092-433c-8d82-01b0f144cfdd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:19.133595 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ce5cdc58-b092-433c-8d82-01b0f144cfdd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:19.185723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ce5cdc58-b092-433c-8d82-01b0f144cfdd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:19.193200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ce5cdc58-b092-433c-8d82-01b0f144cfdd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1217 microversion: 2.1 time: 0.063747 Aug 04 16:25:19.194156 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 135/270] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:19 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:19.266691 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:19.267383 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:19.280603 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:19.281472 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:19.282842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:19.283801 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:19.464550 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:19.475436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1a98db2d-f2d5-4db9-9742-3ae95907b035 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.213250 Aug 04 16:25:19.485139 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 136/271] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:19 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:19.654885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6804772f-6bb3-41cc-85f8-52871f241594 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:19.656386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6804772f-6bb3-41cc-85f8-52871f241594 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:19.663081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6804772f-6bb3-41cc-85f8-52871f241594 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:19.663561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6804772f-6bb3-41cc-85f8-52871f241594 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:19.664330 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6804772f-6bb3-41cc-85f8-52871f241594 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:19.664753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6804772f-6bb3-41cc-85f8-52871f241594 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:22.520947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-717fe6d6-c8cb-4286-884c-a7ec90f0dbdb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 6536 microversion: 2.1 time: 3.582790 Aug 04 16:25:22.521794 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 136/272] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:18 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 6536 bytes in 3585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:22.526932 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:22.527722 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:22.535899 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:22.536337 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:22.537122 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:22.537544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:22.557244 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6804772f-6bb3-41cc-85f8-52871f241594 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 19127 microversion: 2.20 time: 2.905644 Aug 04 16:25:22.558923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 137/273] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:19 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 19127 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:22.568954 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:22.570141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:22.582431 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:22.582775 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:22.583650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:22.584039 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:22.633663 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:22.644586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6049302d-c0c0-4745-a2aa-4c130ce9bc2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1221 microversion: 2.1 time: 0.121415 Aug 04 16:25:22.645557 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 137/274] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:22 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:22.744844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:22.754227 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cd680cd5-db9e-49be-8f97-195cc24c0554 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.193396 Aug 04 16:25:22.755047 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 138/275] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:22 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:23.532292 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fcc99302-1ce3-44d3-8953-f1ba84a3e508 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:23.533589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fcc99302-1ce3-44d3-8953-f1ba84a3e508 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:23.541323 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fcc99302-1ce3-44d3-8953-f1ba84a3e508 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.541774 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fcc99302-1ce3-44d3-8953-f1ba84a3e508 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:23.542610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fcc99302-1ce3-44d3-8953-f1ba84a3e508 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.543031 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fcc99302-1ce3-44d3-8953-f1ba84a3e508 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:23.570956 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3abff84e-0f90-411a-971f-4aa2997354b8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:23.572029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3abff84e-0f90-411a-971f-4aa2997354b8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:23.586746 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3abff84e-0f90-411a-971f-4aa2997354b8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.588123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3abff84e-0f90-411a-971f-4aa2997354b8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:23.589751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3abff84e-0f90-411a-971f-4aa2997354b8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.590240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3abff84e-0f90-411a-971f-4aa2997354b8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:23.653224 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fcc99302-1ce3-44d3-8953-f1ba84a3e508 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 10789 microversion: 2.1 time: 0.124753 Aug 04 16:25:23.654800 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 138/276] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:23 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 10789 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:23.663747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:23.664986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:23.684207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3abff84e-0f90-411a-971f-4aa2997354b8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 19944 microversion: 2.20 time: 0.116343 Aug 04 16:25:23.684925 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.686512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:23.686696 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 139/277] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:23 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 19944 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:23.688201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.689181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:23.769672 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:23.777199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-331cc3e5-af6d-4975-8749-400fdf96436c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1275 microversion: 2.1 time: 0.117709 Aug 04 16:25:23.777428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:23.777905 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 139/278] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:23 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:23.778722 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:23.786311 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.786850 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:23.788549 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:23.789123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:24.002656 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:24.010726 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6974d82c-a307-476e-924a-e574a1ea9302 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.239053 Aug 04 16:25:24.011301 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 140/279] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:23 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:24.666354 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c68fe71b-f7b5-4eca-81e1-f8127d0a2172 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:24.668933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c68fe71b-f7b5-4eca-81e1-f8127d0a2172 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:24.679403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c68fe71b-f7b5-4eca-81e1-f8127d0a2172 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:24.680099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c68fe71b-f7b5-4eca-81e1-f8127d0a2172 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:24.681204 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c68fe71b-f7b5-4eca-81e1-f8127d0a2172 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:24.681767 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c68fe71b-f7b5-4eca-81e1-f8127d0a2172 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:24.696909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-afe9834e-db93-41ff-96cb-b0aa125aa946 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:24.698035 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-afe9834e-db93-41ff-96cb-b0aa125aa946 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:24.704987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afe9834e-db93-41ff-96cb-b0aa125aa946 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:24.705472 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afe9834e-db93-41ff-96cb-b0aa125aa946 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:24.706288 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afe9834e-db93-41ff-96cb-b0aa125aa946 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:24.706886 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afe9834e-db93-41ff-96cb-b0aa125aa946 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:24.811776 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c68fe71b-f7b5-4eca-81e1-f8127d0a2172 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 14890 microversion: 2.1 time: 0.149906 Aug 04 16:25:24.812445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 140/280] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:24 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 14890 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:24.817753 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:24.818488 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:24.823154 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-afe9834e-db93-41ff-96cb-b0aa125aa946 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 21513 microversion: 2.20 time: 0.129647 Aug 04 16:25:24.824015 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 141/281] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:24 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 21513 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:24.828594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:24.828594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:24.828594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:24.829345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:24.998789 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:25.006359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c6308754-8e4d-4fdb-839a-c5dc55c40624 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.192676 Aug 04 16:25:25.007008 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 141/282] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:24 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:25.030346 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:25.031241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:25.040294 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:25.040733 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:25.041710 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:25.042267 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:25.258217 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:25.267461 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0cfed651-e94b-4833-ba73-d40dd23d1083 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.241918 Aug 04 16:25:25.275169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 142/283] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:25 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:25.399347 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-7f57203f-b925-41ab-8a16-4e6a569b3fdf req-abd6fb72-ec23-45f4-8543-5536f5137295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633aa183-b18b-4a00-b5c5-544b98236747", "tag": "47499106-0a08-49c1-893b-db6e05e577ca"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:25.400885 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:25:25.400885 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:25:25.408189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-7f57203f-b925-41ab-8a16-4e6a569b3fdf req-abd6fb72-ec23-45f4-8543-5536f5137295 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:25.408612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-7f57203f-b925-41ab-8a16-4e6a569b3fdf req-abd6fb72-ec23-45f4-8543-5536f5137295 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:25.420564 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-7f57203f-b925-41ab-8a16-4e6a569b3fdf req-abd6fb72-ec23-45f4-8543-5536f5137295 service nova] Creating event network-changed:47499106-0a08-49c1-893b-db6e05e577ca for instance 633aa183-b18b-4a00-b5c5-544b98236747 on hv-cinder-78956 Aug 04 16:25:25.425613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-7f57203f-b925-41ab-8a16-4e6a569b3fdf req-abd6fb72-ec23-45f4-8543-5536f5137295 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029942 Aug 04 16:25:25.427867 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 142/284] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:25:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:25:25.826826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2a47c91a-38a0-484d-8de6-17879bce21ea tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:25.827791 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2a47c91a-38a0-484d-8de6-17879bce21ea tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:25.835186 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a47c91a-38a0-484d-8de6-17879bce21ea tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:25.835639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a47c91a-38a0-484d-8de6-17879bce21ea tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:25.836468 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a47c91a-38a0-484d-8de6-17879bce21ea tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:25.837163 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a47c91a-38a0-484d-8de6-17879bce21ea tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:25.838954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-713f3011-73da-41ed-a514-77a627866b26 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:25.840090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-713f3011-73da-41ed-a514-77a627866b26 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:25.849879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-713f3011-73da-41ed-a514-77a627866b26 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:25.850602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-713f3011-73da-41ed-a514-77a627866b26 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:25.851567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-713f3011-73da-41ed-a514-77a627866b26 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:25.852142 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-713f3011-73da-41ed-a514-77a627866b26 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:25.974153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2a47c91a-38a0-484d-8de6-17879bce21ea tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 16113 microversion: 2.1 time: 0.151120 Aug 04 16:25:25.975102 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 143/285] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:25 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 16113 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:26.004558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-713f3011-73da-41ed-a514-77a627866b26 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 22538 microversion: 2.20 time: 0.171528 Aug 04 16:25:26.005527 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 143/286] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:25 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 22538 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:26.029708 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:26.031272 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:26.040748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:26.041254 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:26.042076 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:26.042578 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:26.285396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:26.289284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:26.295989 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:26.303018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:26.306225 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:26.306738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:26.307736 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:26.320060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f745da98-724b-476a-9fc3-c4b44efbc24a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.298244 Aug 04 16:25:26.320888 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 144/287] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:26 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:26.510895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:26.519342 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-28eca41e-d9bf-4f15-b039-66f731842c54 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1520 microversion: 2.1 time: 0.238168 Aug 04 16:25:26.519953 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 144/288] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:26 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:26.988046 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cede9faf-127b-4c37-9f19-8ca49f3116a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:26.988865 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cede9faf-127b-4c37-9f19-8ca49f3116a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:26.995806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cede9faf-127b-4c37-9f19-8ca49f3116a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:26.996438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cede9faf-127b-4c37-9f19-8ca49f3116a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:26.997318 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cede9faf-127b-4c37-9f19-8ca49f3116a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:26.997838 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cede9faf-127b-4c37-9f19-8ca49f3116a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.016849 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0b0bdaf9-832e-4f98-ac20-760472a564df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:27.017875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0b0bdaf9-832e-4f98-ac20-760472a564df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:27.025851 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b0bdaf9-832e-4f98-ac20-760472a564df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.026600 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b0bdaf9-832e-4f98-ac20-760472a564df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.027409 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b0bdaf9-832e-4f98-ac20-760472a564df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.028124 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b0bdaf9-832e-4f98-ac20-760472a564df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.125569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cede9faf-127b-4c37-9f19-8ca49f3116a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 17349 microversion: 2.1 time: 0.140844 Aug 04 16:25:27.131585 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 145/289] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:26 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 17349 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:27.131926 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0b0bdaf9-832e-4f98-ac20-760472a564df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 22972 microversion: 2.20 time: 0.118219 Aug 04 16:25:27.133509 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 145/290] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:27 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 22972 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:27.341968 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:27.343269 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:27.353170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.353170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.353664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.354132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.489003 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:27.496326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-11eae085-dc4a-4f30-9399-182bb8c2af37 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.160985 Aug 04 16:25:27.496770 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 146/291] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:27 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:27.538413 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:27.539171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:27.545806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.546369 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.547537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.548512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.684059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:27.693366 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fce6aca7-0d95-45f4-a9a7-637602b5573f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1500 microversion: 2.1 time: 0.159629 Aug 04 16:25:27.694093 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 146/292] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:27 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:27.710327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:27.710941 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:27.717608 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.718079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.718850 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:27.719271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:27.983557 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:27.992897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6fdda403-a95e-4c31-8543-69097944234b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1513 microversion: 2.1 time: 0.286842 Aug 04 16:25:27.994038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 147/293] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:27 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:28.139300 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4d392583-8f5e-48ae-b131-e20eb1237d61 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:28.140257 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4d392583-8f5e-48ae-b131-e20eb1237d61 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:28.149562 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-714bcd34-7f15-4aaa-9d6f-9778c120f01b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:28.150353 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d392583-8f5e-48ae-b131-e20eb1237d61 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:28.150798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d392583-8f5e-48ae-b131-e20eb1237d61 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:28.151584 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d392583-8f5e-48ae-b131-e20eb1237d61 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:28.151942 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-714bcd34-7f15-4aaa-9d6f-9778c120f01b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:28.153920 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d392583-8f5e-48ae-b131-e20eb1237d61 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:28.165226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-714bcd34-7f15-4aaa-9d6f-9778c120f01b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:28.166709 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-714bcd34-7f15-4aaa-9d6f-9778c120f01b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:28.168762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-714bcd34-7f15-4aaa-9d6f-9778c120f01b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:28.169746 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-714bcd34-7f15-4aaa-9d6f-9778c120f01b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:28.269314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4d392583-8f5e-48ae-b131-e20eb1237d61 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 17349 microversion: 2.1 time: 0.133581 Aug 04 16:25:28.274516 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 147/294] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:28 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 17349 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:28.304409 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-714bcd34-7f15-4aaa-9d6f-9778c120f01b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 23582 microversion: 2.20 time: 0.159877 Aug 04 16:25:28.305093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 148/295] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:28 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 23582 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:28.519781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:28.520706 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:28.529168 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:28.533302 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:28.534693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:28.535953 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:28.836681 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:28.844698 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ee8a142c-c573-4782-9553-5f452ee1638d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.332189 Aug 04 16:25:28.858412 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 148/296] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:28 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:29.284591 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-34297260-faec-4537-ad28-2dc7dc50a46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:29.286720 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-34297260-faec-4537-ad28-2dc7dc50a46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:29.301490 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-34297260-faec-4537-ad28-2dc7dc50a46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.302460 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-34297260-faec-4537-ad28-2dc7dc50a46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.303820 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-34297260-faec-4537-ad28-2dc7dc50a46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.304477 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-34297260-faec-4537-ad28-2dc7dc50a46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.321419 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-14102693-984a-4e41-8833-8075b55f1dbc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:29.323853 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-14102693-984a-4e41-8833-8075b55f1dbc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:29.335096 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14102693-984a-4e41-8833-8075b55f1dbc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.336332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14102693-984a-4e41-8833-8075b55f1dbc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.339414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14102693-984a-4e41-8833-8075b55f1dbc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.340621 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14102693-984a-4e41-8833-8075b55f1dbc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.436785 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-34297260-faec-4537-ad28-2dc7dc50a46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 17985 microversion: 2.1 time: 0.158823 Aug 04 16:25:29.439220 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 149/297] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:29 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 17985 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:29.480749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-14102693-984a-4e41-8833-8075b55f1dbc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 24241 microversion: 2.20 time: 0.165433 Aug 04 16:25:29.490707 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 149/298] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:29 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 24241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:29.586240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:29.588111 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:29.596106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.597017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.598655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.599581 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.632035 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lazy-loading 'flavor' on Instance uuid 64b045ab-defa-4f38-8178-9d493b95c21c {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:25:29.810971 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-84ab49e5-d7c8-4875-8c6f-939dcecbc1d5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action" status: 200 len: 32 microversion: 2.1 time: 0.229372 Aug 04 16:25:29.812399 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 150/299] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:29 2021] POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:25:29.823360 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:29.824997 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:29.835074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.837736 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.838948 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.842364 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.879263 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:29.880947 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:29.892564 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.893090 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:29.893957 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:29.894444 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:30.131241 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:30.140603 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:30.153415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3f9b8543-876a-4a81-98b2-f759379c1be9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.334933 Aug 04 16:25:30.154350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e6a3fa99-9f5c-4dd1-9984-a78d22ceb583 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.294029 Aug 04 16:25:30.155343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 151/300] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:29 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:30.171198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 150/301] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:29 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:30.453450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fefb0bcf-b11e-45e3-9bd7-2cbc441c1c9f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:30.455594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fefb0bcf-b11e-45e3-9bd7-2cbc441c1c9f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:30.469123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fefb0bcf-b11e-45e3-9bd7-2cbc441c1c9f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:30.469123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fefb0bcf-b11e-45e3-9bd7-2cbc441c1c9f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:30.469123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fefb0bcf-b11e-45e3-9bd7-2cbc441c1c9f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:30.469123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fefb0bcf-b11e-45e3-9bd7-2cbc441c1c9f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:30.501234 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a2aa7a27-938c-41e1-88e9-f5398f6350d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:30.503110 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a2aa7a27-938c-41e1-88e9-f5398f6350d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:30.511779 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2aa7a27-938c-41e1-88e9-f5398f6350d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:30.512545 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2aa7a27-938c-41e1-88e9-f5398f6350d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:30.517171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2aa7a27-938c-41e1-88e9-f5398f6350d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:30.517915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2aa7a27-938c-41e1-88e9-f5398f6350d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:30.594020 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fefb0bcf-b11e-45e3-9bd7-2cbc441c1c9f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 19342 microversion: 2.1 time: 0.146650 Aug 04 16:25:30.595599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 152/302] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:30 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 19342 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:30.650144 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a2aa7a27-938c-41e1-88e9-f5398f6350d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 24763 microversion: 2.20 time: 0.157382 Aug 04 16:25:30.651629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 151/303] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:30 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 24763 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:31.197938 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:31.199921 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:31.201475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:31.202979 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:31.211704 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.212354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.213197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.213629 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.245888 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.246965 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.248236 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.248831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.522034 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:31.533985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8c594d14-3775-4a0f-bf23-a074dbdf8253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.337368 Aug 04 16:25:31.535368 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 152/304] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:31 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:31.607151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-07a44c9b-e52e-4ad5-b165-24760c27188e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:31.608074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-07a44c9b-e52e-4ad5-b165-24760c27188e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:31.615781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07a44c9b-e52e-4ad5-b165-24760c27188e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.616622 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07a44c9b-e52e-4ad5-b165-24760c27188e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.617551 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07a44c9b-e52e-4ad5-b165-24760c27188e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.618157 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07a44c9b-e52e-4ad5-b165-24760c27188e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.703225 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:31.721169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-62ef5030-04f1-4b3f-877a-05c750b9a9f1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.528995 Aug 04 16:25:31.727986 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 153/305] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:31 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:31.732947 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8246b96e-de52-4ff5-97bd-6720eaf3b026 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:31.734246 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8246b96e-de52-4ff5-97bd-6720eaf3b026 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:31.741859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8246b96e-de52-4ff5-97bd-6720eaf3b026 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.743303 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8246b96e-de52-4ff5-97bd-6720eaf3b026 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.744489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8246b96e-de52-4ff5-97bd-6720eaf3b026 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:31.745341 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-07a44c9b-e52e-4ad5-b165-24760c27188e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 20985 microversion: 2.1 time: 0.142145 Aug 04 16:25:31.745640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8246b96e-de52-4ff5-97bd-6720eaf3b026 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:31.746690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 153/306] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:31 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 20985 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:31.851956 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8246b96e-de52-4ff5-97bd-6720eaf3b026 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 25501 microversion: 2.20 time: 0.121469 Aug 04 16:25:31.852885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 154/307] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:31 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 25501 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:32.553312 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:32.554787 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:32.568879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.569419 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:32.570327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.577985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:32.740500 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:32.741269 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:32.749922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.750907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:32.752248 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.753406 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:32.779479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:32.789235 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-29ba24da-7f20-44f0-86fe-75a9a5fa3ee2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.239929 Aug 04 16:25:32.793393 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 154/308] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:32 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:32.807382 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-21ad2985-f6c2-45fc-9f39-50019fdb6142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:32.808605 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-21ad2985-f6c2-45fc-9f39-50019fdb6142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:32.815697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21ad2985-f6c2-45fc-9f39-50019fdb6142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.816386 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21ad2985-f6c2-45fc-9f39-50019fdb6142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:32.817378 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21ad2985-f6c2-45fc-9f39-50019fdb6142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.818005 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21ad2985-f6c2-45fc-9f39-50019fdb6142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:32.925090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-21ad2985-f6c2-45fc-9f39-50019fdb6142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 22205 microversion: 2.1 time: 0.129654 Aug 04 16:25:32.927187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 155/309] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:32 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 22205 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:32.933892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9a15e968-8c08-4a5d-9186-d19f7b05af37 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:32.935486 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9a15e968-8c08-4a5d-9186-d19f7b05af37 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:32.951558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9a15e968-8c08-4a5d-9186-d19f7b05af37 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.953564 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9a15e968-8c08-4a5d-9186-d19f7b05af37 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:32.955356 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9a15e968-8c08-4a5d-9186-d19f7b05af37 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:32.955987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9a15e968-8c08-4a5d-9186-d19f7b05af37 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:33.069462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9a15e968-8c08-4a5d-9186-d19f7b05af37 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 26153 microversion: 2.20 time: 0.140376 Aug 04 16:25:33.070537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 156/310] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:32 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 26153 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:33.168015 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:33.177259 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b94fe101-8c29-452b-8adb-5a43e693a9c5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.441717 Aug 04 16:25:33.177855 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 155/311] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:32 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:33.811230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:33.812384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:33.821165 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:33.823081 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:33.828844 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:33.829608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:33.939966 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-924834fb-1710-43e4-8f95-a0f7fb96c524 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:33.941247 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-924834fb-1710-43e4-8f95-a0f7fb96c524 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:33.954807 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-924834fb-1710-43e4-8f95-a0f7fb96c524 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:33.966687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-924834fb-1710-43e4-8f95-a0f7fb96c524 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:33.966687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-924834fb-1710-43e4-8f95-a0f7fb96c524 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:33.966687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-924834fb-1710-43e4-8f95-a0f7fb96c524 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:34.089878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:34.100065 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3dac159c-b2ca-4d78-99c2-4d337e6a2e7a tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.292751 Aug 04 16:25:34.100837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 157/312] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:33 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:34.109308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-65635971-c16b-42f8-b309-85977862a486 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:34.111540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-65635971-c16b-42f8-b309-85977862a486 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:34.120184 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65635971-c16b-42f8-b309-85977862a486 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:34.121137 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65635971-c16b-42f8-b309-85977862a486 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:34.122747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65635971-c16b-42f8-b309-85977862a486 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:34.123500 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65635971-c16b-42f8-b309-85977862a486 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:34.214730 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-65635971-c16b-42f8-b309-85977862a486 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 26859 microversion: 2.20 time: 0.110420 Aug 04 16:25:34.215563 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 158/313] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:34 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 26859 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:34.230664 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:34.232400 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:34.241345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:34.242505 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:34.243572 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:34.244255 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:34.293550 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-924834fb-1710-43e4-8f95-a0f7fb96c524 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 23218 microversion: 2.1 time: 0.358099 Aug 04 16:25:34.294221 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 156/314] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:33 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 23218 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:34.303756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-1fb6839c-0a52-4e85-9f9c-a37e27b91aa3 req-19f3fabb-9d6b-4885-9387-dc2f3f66b8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633aa183-b18b-4a00-b5c5-544b98236747", "name": "network-vif-plugged", "status": "completed", "tag": "47499106-0a08-49c1-893b-db6e05e577ca"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:34.306620 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:25:34.306620 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:25:34.321395 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-1fb6839c-0a52-4e85-9f9c-a37e27b91aa3 req-19f3fabb-9d6b-4885-9387-dc2f3f66b8b6 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:34.322144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-1fb6839c-0a52-4e85-9f9c-a37e27b91aa3 req-19f3fabb-9d6b-4885-9387-dc2f3f66b8b6 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:34.353909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-1fb6839c-0a52-4e85-9f9c-a37e27b91aa3 req-19f3fabb-9d6b-4885-9387-dc2f3f66b8b6 service nova] Creating event network-vif-plugged:47499106-0a08-49c1-893b-db6e05e577ca for instance 633aa183-b18b-4a00-b5c5-544b98236747 on hv-cinder-78956 Aug 04 16:25:34.361080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-1fb6839c-0a52-4e85-9f9c-a37e27b91aa3 req-19f3fabb-9d6b-4885-9387-dc2f3f66b8b6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063750 Aug 04 16:25:34.362424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 157/315] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:25:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:25:34.442844 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:34.451532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4f20f184-eab9-43ee-af28-8f451bfb580f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.230855 Aug 04 16:25:34.452118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 159/316] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:34 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:35.119061 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:35.119818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:35.131920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.133358 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.135201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.136180 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.239041 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0c093d45-249a-43ba-8aef-99e73c4a74c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:35.240840 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0c093d45-249a-43ba-8aef-99e73c4a74c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:35.254567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c093d45-249a-43ba-8aef-99e73c4a74c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.257912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c093d45-249a-43ba-8aef-99e73c4a74c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.260661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c093d45-249a-43ba-8aef-99e73c4a74c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.262580 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c093d45-249a-43ba-8aef-99e73c4a74c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.393358 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:35.396365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0c093d45-249a-43ba-8aef-99e73c4a74c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 27347 microversion: 2.20 time: 0.172334 Aug 04 16:25:35.398030 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 160/317] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:35 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 27347 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:25:35.404144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-89d5d292-2d2a-4820-8166-39a9d6683522 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.290777 Aug 04 16:25:35.404839 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-468fcdcc-c535-4c76-b330-d7c8ab6d7b77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:35.406303 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 158/318] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:35 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:35.411041 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-468fcdcc-c535-4c76-b330-d7c8ab6d7b77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:35.419478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-468fcdcc-c535-4c76-b330-d7c8ab6d7b77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.420022 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-468fcdcc-c535-4c76-b330-d7c8ab6d7b77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.420813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-468fcdcc-c535-4c76-b330-d7c8ab6d7b77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.421247 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-468fcdcc-c535-4c76-b330-d7c8ab6d7b77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.469456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:35.471206 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:35.477794 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.478377 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.479664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:35.480600 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:35.518804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-468fcdcc-c535-4c76-b330-d7c8ab6d7b77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 24110 microversion: 2.1 time: 0.118625 Aug 04 16:25:35.519976 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 161/319] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:35 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 24110 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:35.694650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:35.703448 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-eac7ee9a-c7dd-4105-bb02-8421323ba273 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1317 microversion: 2.1 time: 0.238506 Aug 04 16:25:35.705235 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 159/320] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:35 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:36.413112 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d6d28704-603e-4b0c-a8c9-fa2e925c8041 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:36.414877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d6d28704-603e-4b0c-a8c9-fa2e925c8041 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:36.424613 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:36.425830 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:36.435349 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.436137 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:36.438319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.439021 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:36.448602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6d28704-603e-4b0c-a8c9-fa2e925c8041 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.449050 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6d28704-603e-4b0c-a8c9-fa2e925c8041 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:36.450160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6d28704-603e-4b0c-a8c9-fa2e925c8041 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.450581 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6d28704-603e-4b0c-a8c9-fa2e925c8041 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:36.553062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d6d28704-603e-4b0c-a8c9-fa2e925c8041 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 27539 microversion: 2.20 time: 0.146590 Aug 04 16:25:36.554974 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 162/321] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:36 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 27539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:36.566331 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-35a215e2-e56e-461e-8c02-04068013cbb6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:36.568458 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-35a215e2-e56e-461e-8c02-04068013cbb6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:36.590518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35a215e2-e56e-461e-8c02-04068013cbb6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.592592 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35a215e2-e56e-461e-8c02-04068013cbb6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:36.594755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35a215e2-e56e-461e-8c02-04068013cbb6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.596515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35a215e2-e56e-461e-8c02-04068013cbb6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:36.728372 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:36.737067 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-35a215e2-e56e-461e-8c02-04068013cbb6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 24769 microversion: 2.1 time: 0.180550 Aug 04 16:25:36.738187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 163/322] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:36 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 24769 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:36.741588 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8d3bc397-9bc1-4f68-85ef-a4eaf7e77ac8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.318689 Aug 04 16:25:36.752202 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:36.752202 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:36.753008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 160/323] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:36 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:36.760913 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.761555 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:36.762728 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:36.763337 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:37.050364 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:37.066673 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-87970025-602d-4473-8697-32e44eeed0b6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1507 microversion: 2.1 time: 0.327543 Aug 04 16:25:37.067827 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 164/324] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:36 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:37.567046 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-063fe081-85e1-4ed8-9c8d-91f56abb3484 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:37.568080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-063fe081-85e1-4ed8-9c8d-91f56abb3484 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:37.574255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-063fe081-85e1-4ed8-9c8d-91f56abb3484 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:37.574709 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-063fe081-85e1-4ed8-9c8d-91f56abb3484 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:37.575488 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-063fe081-85e1-4ed8-9c8d-91f56abb3484 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:37.576107 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-063fe081-85e1-4ed8-9c8d-91f56abb3484 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:37.748710 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-478f93fd-bad6-4f98-b406-fd3b7902e932 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:37.751998 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-478f93fd-bad6-4f98-b406-fd3b7902e932 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:37.772939 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-478f93fd-bad6-4f98-b406-fd3b7902e932 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:37.773710 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-478f93fd-bad6-4f98-b406-fd3b7902e932 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:37.774709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-478f93fd-bad6-4f98-b406-fd3b7902e932 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:37.775292 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-478f93fd-bad6-4f98-b406-fd3b7902e932 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:40.472330 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-063fe081-85e1-4ed8-9c8d-91f56abb3484 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 27781 microversion: 2.20 time: 2.910065 Aug 04 16:25:40.472951 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 161/325] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:37 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 27781 bytes in 2913 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:40.478661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:40.479366 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:40.487836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:40.488382 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:40.489428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:40.489869 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:40.494267 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-478f93fd-bad6-4f98-b406-fd3b7902e932 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 26691 microversion: 2.1 time: 2.748961 Aug 04 16:25:40.498432 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 165/326] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:37 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 26691 bytes in 2751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:40.646606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:40.655846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5a171d67-2135-4f7a-96a8-73a9b4704a6f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.181653 Aug 04 16:25:40.656355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 162/327] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:40 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:41.505685 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4ab596b4-a3af-4ff5-bd1e-32994d3a635d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:41.506503 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-48b11e48-dd18-4879-b6a0-59c739dfdf69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:41.507524 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-48b11e48-dd18-4879-b6a0-59c739dfdf69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:41.508546 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4ab596b4-a3af-4ff5-bd1e-32994d3a635d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:41.525872 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-48b11e48-dd18-4879-b6a0-59c739dfdf69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:41.526461 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-48b11e48-dd18-4879-b6a0-59c739dfdf69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:41.527000 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4ab596b4-a3af-4ff5-bd1e-32994d3a635d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:41.527438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-48b11e48-dd18-4879-b6a0-59c739dfdf69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:41.527942 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-48b11e48-dd18-4879-b6a0-59c739dfdf69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:41.528129 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4ab596b4-a3af-4ff5-bd1e-32994d3a635d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:41.529410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4ab596b4-a3af-4ff5-bd1e-32994d3a635d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:41.530318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4ab596b4-a3af-4ff5-bd1e-32994d3a635d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:44.905934 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4ab596b4-a3af-4ff5-bd1e-32994d3a635d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 28132 microversion: 2.20 time: 3.416762 Aug 04 16:25:44.911334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-48b11e48-dd18-4879-b6a0-59c739dfdf69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 27737 microversion: 2.1 time: 3.408051 Aug 04 16:25:44.919434 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 166/328] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:41 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 28132 bytes in 3434 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:44.927878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:44.928367 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 163/329] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:41 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 27737 bytes in 3426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:44.935145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bfe84a91-bc47-445e-81b9-2713a0afae75 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a52fd47f-2c90-4c52-b079-364bf07014f0"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:44.936865 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bfe84a91-bc47-445e-81b9-2713a0afae75 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:44.939062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:44.952071 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:44.953055 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:44.954036 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bfe84a91-bc47-445e-81b9-2713a0afae75 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:44.954492 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:44.955147 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:44.955881 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bfe84a91-bc47-445e-81b9-2713a0afae75 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:44.957272 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bfe84a91-bc47-445e-81b9-2713a0afae75 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:44.958286 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bfe84a91-bc47-445e-81b9-2713a0afae75 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:45.139468 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:45.148537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-80a79792-4108-4d66-8ccb-b28294c750ee tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.226873 Aug 04 16:25:45.149385 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 167/330] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:44 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:45.452808 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bfe84a91-bc47-445e-81b9-2713a0afae75 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522483 Aug 04 16:25:45.455236 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 164/331] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:25:44 2021] POST /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:25:45.932431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cadaa599-cdaa-4f4a-9283-c34ad8cf16e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:45.933006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-eb9a2b17-766b-480b-990e-e4e750591878 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:45.933356 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cadaa599-cdaa-4f4a-9283-c34ad8cf16e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:45.934527 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-eb9a2b17-766b-480b-990e-e4e750591878 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:45.946173 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cadaa599-cdaa-4f4a-9283-c34ad8cf16e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:45.953359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cadaa599-cdaa-4f4a-9283-c34ad8cf16e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:45.955542 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cadaa599-cdaa-4f4a-9283-c34ad8cf16e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:45.955725 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb9a2b17-766b-480b-990e-e4e750591878 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:45.956143 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb9a2b17-766b-480b-990e-e4e750591878 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:45.957192 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cadaa599-cdaa-4f4a-9283-c34ad8cf16e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:45.957474 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb9a2b17-766b-480b-990e-e4e750591878 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:45.958261 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb9a2b17-766b-480b-990e-e4e750591878 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:46.041449 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cadaa599-cdaa-4f4a-9283-c34ad8cf16e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 28132 microversion: 2.20 time: 0.115601 Aug 04 16:25:46.042457 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 168/332] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:45 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 28132 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:46.078583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-eb9a2b17-766b-480b-990e-e4e750591878 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 28087 microversion: 2.1 time: 0.151311 Aug 04 16:25:46.079677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 165/333] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:45 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 28087 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:46.166709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:46.167761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:46.175075 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:46.175496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:46.176613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:46.176993 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:46.349572 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:46.358581 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6612e38d-7954-4751-a8ba-6ae9c9beb2de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.195669 Aug 04 16:25:46.359245 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 169/334] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:46 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:47.064799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d1e083e9-db0a-47d7-8fc3-effbc0206c7c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:47.066754 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d1e083e9-db0a-47d7-8fc3-effbc0206c7c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:47.088872 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d1e083e9-db0a-47d7-8fc3-effbc0206c7c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:47.089667 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d1e083e9-db0a-47d7-8fc3-effbc0206c7c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:47.091334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d1e083e9-db0a-47d7-8fc3-effbc0206c7c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:47.091947 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d1e083e9-db0a-47d7-8fc3-effbc0206c7c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:47.092692 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-65516d6d-0470-4adb-b534-c2e342cae1f9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:47.093651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-65516d6d-0470-4adb-b534-c2e342cae1f9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:47.103847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65516d6d-0470-4adb-b534-c2e342cae1f9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:47.104294 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65516d6d-0470-4adb-b534-c2e342cae1f9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:47.105169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65516d6d-0470-4adb-b534-c2e342cae1f9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:47.105612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65516d6d-0470-4adb-b534-c2e342cae1f9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:47.185029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d1e083e9-db0a-47d7-8fc3-effbc0206c7c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 28132 microversion: 2.20 time: 0.126184 Aug 04 16:25:47.185630 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 166/335] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:47 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 28132 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:47.205330 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-65516d6d-0470-4adb-b534-c2e342cae1f9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 28147 microversion: 2.1 time: 0.116787 Aug 04 16:25:47.206030 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 170/336] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:47 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 28147 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:47.385350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:47.386415 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:47.402096 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:47.402984 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:47.403948 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:47.404521 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:47.556435 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:47.565599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-08c31a0d-70f2-4b9b-a560-a4041ec0a17d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.188857 Aug 04 16:25:47.576313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 167/337] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:47 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:48.205387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1eb08b46-6218-4236-8b5c-dca0701b1b52 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:48.206524 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1eb08b46-6218-4236-8b5c-dca0701b1b52 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:48.221222 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1eb08b46-6218-4236-8b5c-dca0701b1b52 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:48.221986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1eb08b46-6218-4236-8b5c-dca0701b1b52 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:48.223338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1eb08b46-6218-4236-8b5c-dca0701b1b52 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:48.223947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1eb08b46-6218-4236-8b5c-dca0701b1b52 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:48.225797 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a466f17e-2a24-4958-bfd9-4060088968e8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:48.227665 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a466f17e-2a24-4958-bfd9-4060088968e8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:48.251638 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a466f17e-2a24-4958-bfd9-4060088968e8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:48.254252 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a466f17e-2a24-4958-bfd9-4060088968e8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:48.258236 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a466f17e-2a24-4958-bfd9-4060088968e8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:48.261995 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a466f17e-2a24-4958-bfd9-4060088968e8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:48.325070 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1eb08b46-6218-4236-8b5c-dca0701b1b52 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 28423 microversion: 2.20 time: 0.130912 Aug 04 16:25:48.326519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 171/338] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:48 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 28423 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:25:48.418108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a466f17e-2a24-4958-bfd9-4060088968e8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 28147 microversion: 2.1 time: 0.201836 Aug 04 16:25:48.426194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 168/339] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:48 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 28147 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:48.587843 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:48.589273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:48.597462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:48.598223 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:48.601423 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:48.602189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:48.764749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:48.777169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-414c0f34-73ab-4611-a00b-96a9740941c3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.196635 Aug 04 16:25:48.777787 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 172/340] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:48 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:49.341203 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-860ff3f7-8579-4cb9-9386-98fd5ed0ce70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:49.342992 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-860ff3f7-8579-4cb9-9386-98fd5ed0ce70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:49.351525 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-860ff3f7-8579-4cb9-9386-98fd5ed0ce70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:49.351971 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-860ff3f7-8579-4cb9-9386-98fd5ed0ce70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:49.352806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-860ff3f7-8579-4cb9-9386-98fd5ed0ce70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:49.353247 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-860ff3f7-8579-4cb9-9386-98fd5ed0ce70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:49.448010 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0efa8ab7-fc17-40e6-866b-7f88839ffd69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:49.449688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0efa8ab7-fc17-40e6-866b-7f88839ffd69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:49.457093 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0efa8ab7-fc17-40e6-866b-7f88839ffd69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:49.457547 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0efa8ab7-fc17-40e6-866b-7f88839ffd69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:49.458403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0efa8ab7-fc17-40e6-866b-7f88839ffd69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:49.459183 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0efa8ab7-fc17-40e6-866b-7f88839ffd69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:51.865060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-860ff3f7-8579-4cb9-9386-98fd5ed0ce70 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 28423 microversion: 2.20 time: 2.527361 Aug 04 16:25:51.866677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 169/341] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:49 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 28423 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:51.868561 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0efa8ab7-fc17-40e6-866b-7f88839ffd69 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 28437 microversion: 2.1 time: 2.438689 Aug 04 16:25:51.869552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 173/342] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:49 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 28437 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:51.880356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:51.880356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:51.880704 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-48a47c32-bfb1-44f1-9e2c-9861d6d911c7 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Action: 'create', calling method: .version_select at 0x7f271846b550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-800586162"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:51.886583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:51.887110 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:51.888015 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:51.888501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:51.902776 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-48a47c32-bfb1-44f1-9e2c-9861d6d911c7 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Getting quotas for project c5b483243f1443f891eee772089355e6. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:25:51.906790 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-48a47c32-bfb1-44f1-9e2c-9861d6d911c7 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Getting quotas for user ffc84bb769c84dda9cd539b89dbb9fed and project c5b483243f1443f891eee772089355e6. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:25:52.020382 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:52.031500 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9b0b9304-6fe2-4b19-8df6-43967511b37d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.162303 Aug 04 16:25:52.032389 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 170/343] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:51 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:52.200068 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-48a47c32-bfb1-44f1-9e2c-9861d6d911c7 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Getting quotas for project c5b483243f1443f891eee772089355e6. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:25:52.205181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-48a47c32-bfb1-44f1-9e2c-9861d6d911c7 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Getting quotas for user ffc84bb769c84dda9cd539b89dbb9fed and project c5b483243f1443f891eee772089355e6. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:25:52.219794 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-48a47c32-bfb1-44f1-9e2c-9861d6d911c7 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.343447 Aug 04 16:25:52.220391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 174/344] 10.222.0.77 () {60 vars in 1158 bytes} [Wed Aug 4 16:25:51 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:52.271176 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-968209230", "imageRef": "af787ba7-e53d-46e8-a627-a475c8e3e2b7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-800586162", "networks": [{"uuid": "ac7cd450-e44f-4fa4-b535-c94ee7de8b1a"}]}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:52.327294 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] validate_networks() for [('ac7cd450-e44f-4fa4-b535-c94ee7de8b1a', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:25:52.727456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:25:52.727893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:25:52.728335 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:25:52.728742 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:25:52.729169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:25:52.738206 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:52.738733 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:52.739607 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:52.740122 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:52.758344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Getting quotas for project c5b483243f1443f891eee772089355e6. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:25:52.762565 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Getting quotas for user ffc84bb769c84dda9cd539b89dbb9fed and project c5b483243f1443f891eee772089355e6. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:25:52.776273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:25:52.778577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af787ba7-e53d-46e8-a627-a475c8e3e2b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:25:52.843892 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e4ea72ac-a5b3-4af9-8e11-94ae6156a7cd tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576252 Aug 04 16:25:52.844882 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 171/345] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:25:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:25:52.854768 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-eff9f81c-977a-4d1e-860f-30db4650a743 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:52.855494 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-eff9f81c-977a-4d1e-860f-30db4650a743 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:52.879721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-756d3610-8e7e-45cb-a0df-7552bcac203d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:52.881518 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-756d3610-8e7e-45cb-a0df-7552bcac203d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:52.888994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-756d3610-8e7e-45cb-a0df-7552bcac203d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:52.889453 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-756d3610-8e7e-45cb-a0df-7552bcac203d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:52.890274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-756d3610-8e7e-45cb-a0df-7552bcac203d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:52.890703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-756d3610-8e7e-45cb-a0df-7552bcac203d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:52.942078 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-eff9f81c-977a-4d1e-860f-30db4650a743 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:52.950204 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-eff9f81c-977a-4d1e-860f-30db4650a743 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1257 microversion: 2.1 time: 0.099320 Aug 04 16:25:52.951212 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 175/346] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:52 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1257 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:52.956801 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6efd2876-5a77-4cbb-ad50-0a02ae14cafd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:52.959021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6efd2876-5a77-4cbb-ad50-0a02ae14cafd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:52.970034 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6efd2876-5a77-4cbb-ad50-0a02ae14cafd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:52.970859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6efd2876-5a77-4cbb-ad50-0a02ae14cafd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:52.972428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6efd2876-5a77-4cbb-ad50-0a02ae14cafd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:52.973055 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6efd2876-5a77-4cbb-ad50-0a02ae14cafd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.004124 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-756d3610-8e7e-45cb-a0df-7552bcac203d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 28588 microversion: 2.20 time: 0.128654 Aug 04 16:25:53.005750 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 172/347] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:52 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 28588 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:25:53.095375 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6efd2876-5a77-4cbb-ad50-0a02ae14cafd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 28437 microversion: 2.1 time: 0.142670 Aug 04 16:25:53.096425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 176/348] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:52 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 28437 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:25:53.101420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:53.102385 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:53.109354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.110208 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.111264 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.111777 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.263780 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:53.272615 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e84ae8a3-7178-4a2c-b877-2b298396ae47 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1499 microversion: 2.1 time: 0.178769 Aug 04 16:25:53.273241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 173/349] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:53 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1499 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:53.292355 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af23a0ff-51cc-41c8-98d1-4ca7dffb04f2"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:53.293646 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:53.301708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.302436 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.303353 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.303924 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.329898 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] HTTP exception thrown: Cannot 'attach_volume' instance 64b045ab-defa-4f38-8178-9d493b95c21c while it is in vm_state rescued Aug 04 16:25:53.330524 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Returning 409 to user: Cannot 'attach_volume' instance 64b045ab-defa-4f38-8178-9d493b95c21c while it is in vm_state rescued {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:25:53.331357 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a440e419-f76e-4f1e-822f-7e979d99bced tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043802 Aug 04 16:25:53.331903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 177/350] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:25:53 2021] POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:25:53.340929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-22d91017-e5c1-47f1-bfa6-a3bdf601ce53 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:53.341462 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-22d91017-e5c1-47f1-bfa6-a3bdf601ce53 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:53.347612 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22d91017-e5c1-47f1-bfa6-a3bdf601ce53 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.348123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22d91017-e5c1-47f1-bfa6-a3bdf601ce53 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.348799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22d91017-e5c1-47f1-bfa6-a3bdf601ce53 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.349253 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22d91017-e5c1-47f1-bfa6-a3bdf601ce53 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.419771 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-22d91017-e5c1-47f1-bfa6-a3bdf601ce53 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action" status: 202 len: 0 microversion: 2.1 time: 0.082356 Aug 04 16:25:53.424039 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 174/351] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:53 2021] POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:53.433516 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:53.434247 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:53.443337 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.444597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.445505 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.445942 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.590675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:53.599452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2759a3ef-8b8c-4f2a-8b65-96c873eafedb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1507 microversion: 2.1 time: 0.169806 Aug 04 16:25:53.600033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 178/352] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:53 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:53.969159 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:53.969854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:53.977157 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.977598 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:53.978541 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:53.978963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.016725 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-785ee537-9147-47ac-bab7-9e73e3406ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:54.017664 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-785ee537-9147-47ac-bab7-9e73e3406ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:54.024066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-785ee537-9147-47ac-bab7-9e73e3406ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.024737 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-785ee537-9147-47ac-bab7-9e73e3406ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.025525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-785ee537-9147-47ac-bab7-9e73e3406ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.025938 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-785ee537-9147-47ac-bab7-9e73e3406ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.058131 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:54.067006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-325f6ddf-f43c-43ae-a14b-ba5f27eb9ac0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1309 microversion: 2.1 time: 0.102126 Aug 04 16:25:54.068245 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 175/353] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:53 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:54.107707 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c880e6ce-157e-40da-b1ea-59cff958ee17 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:54.108851 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c880e6ce-157e-40da-b1ea-59cff958ee17 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:54.122141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c880e6ce-157e-40da-b1ea-59cff958ee17 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.122141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c880e6ce-157e-40da-b1ea-59cff958ee17 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.122141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c880e6ce-157e-40da-b1ea-59cff958ee17 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.122141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c880e6ce-157e-40da-b1ea-59cff958ee17 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.169878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-785ee537-9147-47ac-bab7-9e73e3406ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 28588 microversion: 2.20 time: 0.156859 Aug 04 16:25:54.170903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 179/354] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:54 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 28588 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:54.197121 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c880e6ce-157e-40da-b1ea-59cff958ee17 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 28603 microversion: 2.1 time: 0.092944 Aug 04 16:25:54.197781 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 176/355] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:54 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 28603 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:25:54.221874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a52fd47f-2c90-4c52-b079-364bf07014f0"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:54.223122 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:54.230954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.231462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.232475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.232908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.365290 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] HTTP exception thrown: Invalid volume: volume a52fd47f-2c90-4c52-b079-364bf07014f0 is already attached to instances: 633aa183-b18b-4a00-b5c5-544b98236747 Aug 04 16:25:54.365899 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Returning 400 to user: Invalid volume: volume a52fd47f-2c90-4c52-b079-364bf07014f0 is already attached to instances: 633aa183-b18b-4a00-b5c5-544b98236747 {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:25:54.366805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0ed34f62-3a96-4ba0-b6e0-4b00a9ad4ab1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149619 Aug 04 16:25:54.367382 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 180/356] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:25:54 2021] POST /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:25:54.440045 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:54.440972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:54.447616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.448123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.448904 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.449337 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.539325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lazy-loading 'services' on Instance uuid 633aa183-b18b-4a00-b5c5-544b98236747 {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:25:54.622098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ab3f7199-a46e-40e4-9fbe-e34d25ca8c42 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "DELETE /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747/os-volume_attachments/a52fd47f-2c90-4c52-b079-364bf07014f0" status: 202 len: 0 microversion: 2.1 time: 0.186670 Aug 04 16:25:54.623592 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 177/357] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:25:54 2021] DELETE /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747/os-volume_attachments/a52fd47f-2c90-4c52-b079-364bf07014f0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:25:54.631387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:54.631387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:54.647820 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.648273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.649080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:54.649705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:54.820280 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:54.830528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e7f31fb5-5995-47d2-bf14-bf61ce481c93 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1507 microversion: 2.1 time: 0.215942 Aug 04 16:25:54.835144 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 181/358] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:54 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:55.087211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:55.087899 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:55.104586 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:55.105046 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:55.105853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:55.106318 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:55.191798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-64a6c395-c245-4857-85cd-a75da68bfd9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:55.193229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-64a6c395-c245-4857-85cd-a75da68bfd9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:55.219246 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64a6c395-c245-4857-85cd-a75da68bfd9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:55.220246 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64a6c395-c245-4857-85cd-a75da68bfd9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:55.222265 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64a6c395-c245-4857-85cd-a75da68bfd9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:55.223325 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64a6c395-c245-4857-85cd-a75da68bfd9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:55.330204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:25:55.339371 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cc93900f-c451-413d-a542-c61354b53bf0 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.256771 Aug 04 16:25:55.346141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 178/359] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:25:55 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:55.350217 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9a59b991-40f1-4741-940d-a5e7338a2558 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:25:55.351409 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9a59b991-40f1-4741-940d-a5e7338a2558 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:25:55.361244 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a59b991-40f1-4741-940d-a5e7338a2558 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:55.361505 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a59b991-40f1-4741-940d-a5e7338a2558 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:25:55.362500 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a59b991-40f1-4741-940d-a5e7338a2558 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:25:55.362918 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9a59b991-40f1-4741-940d-a5e7338a2558 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:12.006470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-64a6c395-c245-4857-85cd-a75da68bfd9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 35940 microversion: 2.20 time: 16.825919 Aug 04 16:26:12.007105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 182/360] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:25:55 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 35940 bytes in 16828 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:12.012181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:12.012862 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:12.019679 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:12.020198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:12.020984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:12.021415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:12.045082 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9a59b991-40f1-4741-940d-a5e7338a2558 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 34789 microversion: 2.1 time: 16.702749 Aug 04 16:26:12.046457 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 179/361] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:25:55 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 34789 bytes in 16705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:12.052104 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:12.053017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:12.059865 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:12.060322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:12.061114 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:12.061546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:12.161881 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:12.169908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3a1ebe9c-2c21-44f4-8910-b62760267aa0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1507 microversion: 2.1 time: 0.161666 Aug 04 16:26:12.170495 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 183/362] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:12 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:12.174872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1629703388", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "8b73dbfa-1915-4d59-aa47-d7f3a2d43c66"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:12.234992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] validate_networks() for [('8b73dbfa-1915-4d59-aa47-d7f3a2d43c66', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:26:12.309105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:12.317342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-df85f3c2-f64d-4a35-bfa5-57b2b3c9abe1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.269194 Aug 04 16:26:12.318125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 180/363] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:12 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:12.670178 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:26:12.670918 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:26:12.671758 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:26:12.672933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:26:12.673868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:26:12.689480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:12.690251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:12.691287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:12.691780 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:12.710615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Getting quotas for project 5415912273de496e963a7c07ee381732. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:26:12.722059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Getting quotas for user 39928789024c475ca0ffa42106b2f3fe and project 5415912273de496e963a7c07ee381732. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:26:12.735641 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:26:12.737989 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:26:12.786014 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a55d2447-6668-4512-97b9-d120dfa754e5 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614192 Aug 04 16:26:12.787092 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 184/364] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:26:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:26:12.798538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4b162908-7397-448b-b386-f7788d603b87 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:12.799161 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4b162908-7397-448b-b386-f7788d603b87 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:12.933761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4b162908-7397-448b-b386-f7788d603b87 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:12.942512 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4b162908-7397-448b-b386-f7788d603b87 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1214 microversion: 2.1 time: 0.149367 Aug 04 16:26:12.943450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 181/365] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:12 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:13.005792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1924325939", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "adba0a6e-44f8-4a54-84d5-54ff0bc6bb41"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:13.018678 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c735d8b1-c99f-47b7-a8fd-2efa648cde3d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:13.019622 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c735d8b1-c99f-47b7-a8fd-2efa648cde3d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:13.031229 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c735d8b1-c99f-47b7-a8fd-2efa648cde3d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.031870 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c735d8b1-c99f-47b7-a8fd-2efa648cde3d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.032694 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c735d8b1-c99f-47b7-a8fd-2efa648cde3d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.033125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c735d8b1-c99f-47b7-a8fd-2efa648cde3d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.105776 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] validate_networks() for [('adba0a6e-44f8-4a54-84d5-54ff0bc6bb41', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:26:13.157081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c735d8b1-c99f-47b7-a8fd-2efa648cde3d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 36590 microversion: 2.20 time: 0.142318 Aug 04 16:26:13.158349 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 182/366] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:26:13 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 36590 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:26:13.169493 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2161bc0e-3653-46ba-91bd-0ec0d94ff8eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:13.177354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2161bc0e-3653-46ba-91bd-0ec0d94ff8eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:13.199289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2161bc0e-3653-46ba-91bd-0ec0d94ff8eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.201463 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2161bc0e-3653-46ba-91bd-0ec0d94ff8eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.211289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2161bc0e-3653-46ba-91bd-0ec0d94ff8eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.212397 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2161bc0e-3653-46ba-91bd-0ec0d94ff8eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.362382 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2161bc0e-3653-46ba-91bd-0ec0d94ff8eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 35378 microversion: 2.1 time: 0.201786 Aug 04 16:26:13.365313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 183/367] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:13 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 35378 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:13.372428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-85bf0235-2892-41f7-9624-a70ad9714885 req-bcf24e15-d59b-4937-855c-dd92a4eb49d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc4cbe9-9ab3-4a0f-8e98-af6face4a038", "tag": "25c02836-f5d3-4db9-bfb6-3cfc493da78c"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:13.375982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:13.375982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:26:13.386588 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-85bf0235-2892-41f7-9624-a70ad9714885 req-bcf24e15-d59b-4937-855c-dd92a4eb49d1 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.387059 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-85bf0235-2892-41f7-9624-a70ad9714885 req-bcf24e15-d59b-4937-855c-dd92a4eb49d1 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.406790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-85bf0235-2892-41f7-9624-a70ad9714885 req-bcf24e15-d59b-4937-855c-dd92a4eb49d1 service nova] Creating event network-changed:25c02836-f5d3-4db9-bfb6-3cfc493da78c for instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 on hv-cinder-78956 Aug 04 16:26:13.417096 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-85bf0235-2892-41f7-9624-a70ad9714885 req-bcf24e15-d59b-4937-855c-dd92a4eb49d1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048898 Aug 04 16:26:13.423095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 184/368] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:13.429977 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:13.431107 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:13.439975 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.440914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.441977 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.443079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.748719 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:13.756273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6f50ffcc-5feb-4e7c-8374-3a55151d7a7b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1507 microversion: 2.1 time: 0.331569 Aug 04 16:26:13.757132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 185/369] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:13 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:13.761712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:13.762587 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:13.768846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.769316 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.770349 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.771209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.822199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:26:13.822609 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:26:13.823074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:26:13.823464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:26:13.823863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:26:13.832727 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.833640 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.834480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:13.834904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:13.852102 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:26:13.856572 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Getting quotas for user b72fafb88f9f430ca1e561be656dda0f and project 814ea84104dd4ee1b125cc8688bffd7b. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:26:13.868100 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:26:13.870256 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:26:13.920283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2949854f-b035-4fc7-a8ff-cd3976ccd0e2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918573 Aug 04 16:26:13.920984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 185/370] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:26:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:26:13.932936 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-63ec105b-b998-40c0-9a94-7469918a82b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:13.933569 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-63ec105b-b998-40c0-9a94-7469918a82b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:13.994282 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:14.006186 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-050167c2-8767-40e6-b1d0-0d7a3da00ebc tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.247444 Aug 04 16:26:14.006813 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 186/371] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:13 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:14.011522 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:14.012130 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:14.017282 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-63ec105b-b998-40c0-9a94-7469918a82b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:14.026722 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-63ec105b-b998-40c0-9a94-7469918a82b9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1218 microversion: 2.1 time: 0.098860 Aug 04 16:26:14.027947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 186/372] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:13 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:14.039882 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.042299 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.046488 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.046488 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.113766 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:14.122305 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-03477762-493b-432a-8108-a1b7b574a8cc tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1266 microversion: 2.1 time: 0.114335 Aug 04 16:26:14.123011 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 187/373] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:14 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:14.172128 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-af6dd520-ed93-4c3c-9c74-111d4e201487 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:14.173749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-af6dd520-ed93-4c3c-9c74-111d4e201487 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:14.184718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af6dd520-ed93-4c3c-9c74-111d4e201487 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.185441 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af6dd520-ed93-4c3c-9c74-111d4e201487 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.186567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af6dd520-ed93-4c3c-9c74-111d4e201487 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.186987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af6dd520-ed93-4c3c-9c74-111d4e201487 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.328793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-af6dd520-ed93-4c3c-9c74-111d4e201487 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 37292 microversion: 2.20 time: 0.162683 Aug 04 16:26:14.334601 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 187/374] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:26:14 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 37292 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:14.376810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7ecf9d31-d921-4003-848b-f7304f2dfc52 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:14.377744 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7ecf9d31-d921-4003-848b-f7304f2dfc52 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:14.384111 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7ecf9d31-d921-4003-848b-f7304f2dfc52 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.384547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7ecf9d31-d921-4003-848b-f7304f2dfc52 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.385312 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7ecf9d31-d921-4003-848b-f7304f2dfc52 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.385737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7ecf9d31-d921-4003-848b-f7304f2dfc52 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.494217 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7ecf9d31-d921-4003-848b-f7304f2dfc52 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 35884 microversion: 2.1 time: 0.120565 Aug 04 16:26:14.498899 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 188/375] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:14 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 35884 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:14.775285 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:14.776101 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:14.783968 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.784406 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.785424 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:14.786802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:14.925895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:14.933543 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-672517ec-b093-4bf5-ba4b-ebfe267e5674 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1513 microversion: 2.1 time: 0.162978 Aug 04 16:26:14.934345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 188/376] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:14 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:15.023875 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:15.024588 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:15.032331 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.033207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.034544 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.035214 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.045017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:15.045995 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:15.059299 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.059882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.060921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.061570 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.367294 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:15.390158 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-201bfc56-03ff-4c7f-8174-498ec0227a3d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1270 microversion: 2.1 time: 0.347036 Aug 04 16:26:15.391446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 189/377] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:15 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:15.405143 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:15.406751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:15.420179 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.421131 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.422532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.423541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.511829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:15.521149 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ec813235-f447-4a3e-8640-73d7126042ad tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1272 microversion: 2.1 time: 0.126964 Aug 04 16:26:15.521850 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 190/378] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:15 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:15.535088 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:15.536087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1844dbcd-20c5-4f5a-a133-1b98096f5ab6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:15.537117 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1844dbcd-20c5-4f5a-a133-1b98096f5ab6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:15.543597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1844dbcd-20c5-4f5a-a133-1b98096f5ab6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.544037 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1844dbcd-20c5-4f5a-a133-1b98096f5ab6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.544258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-55636e3e-5ff4-4a4b-beee-6b6c4fc89e2e tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.524594 Aug 04 16:26:15.545332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1844dbcd-20c5-4f5a-a133-1b98096f5ab6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.545628 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 189/379] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:15 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:15.545755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1844dbcd-20c5-4f5a-a133-1b98096f5ab6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.550388 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b62983d8-bc75-459b-a554-c7176be975a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:15.551961 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b62983d8-bc75-459b-a554-c7176be975a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:15.559502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b62983d8-bc75-459b-a554-c7176be975a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.560624 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b62983d8-bc75-459b-a554-c7176be975a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.561432 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b62983d8-bc75-459b-a554-c7176be975a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:15.562329 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b62983d8-bc75-459b-a554-c7176be975a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:15.668197 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1844dbcd-20c5-4f5a-a133-1b98096f5ab6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 37942 microversion: 2.20 time: 0.140653 Aug 04 16:26:15.668836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 191/380] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:26:15 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 37942 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:15.698601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b62983d8-bc75-459b-a554-c7176be975a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 36595 microversion: 2.1 time: 0.150978 Aug 04 16:26:15.699574 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 190/381] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:15 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 36595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:16.418691 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:16.419387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:16.427663 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.428101 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.428894 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.429416 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.547850 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:16.550335 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:16.566860 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.568753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.570183 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.570909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.632494 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:16.640180 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4730475c-9290-4152-90fe-d3c4d0026665 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.225531 Aug 04 16:26:16.642478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 192/382] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:16 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:16.646215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:16.647048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:16.654731 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.655457 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.656249 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.656669 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.809832 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:16.821261 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-92ace5a8-2db2-428a-8967-376595a45348 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.177176 Aug 04 16:26:16.822227 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 193/383] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:16 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:16.827096 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:16.827932 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:16.837734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.838845 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.840021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.840805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.956776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:16.968268 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-73050191-6431-4830-812a-32ae9f7d0fcd tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.432105 Aug 04 16:26:16.970299 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 191/384] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:16 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:16.979933 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cc6efe71-756f-419d-a1e9-1f6230d4fb47 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:16.981506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cc6efe71-756f-419d-a1e9-1f6230d4fb47 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:16.987699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc6efe71-756f-419d-a1e9-1f6230d4fb47 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.988149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc6efe71-756f-419d-a1e9-1f6230d4fb47 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.988947 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc6efe71-756f-419d-a1e9-1f6230d4fb47 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:16.989774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cc6efe71-756f-419d-a1e9-1f6230d4fb47 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:16.993274 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:17.000803 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fbab012d-698b-44c7-9a45-c46a7809f7ea tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1513 microversion: 2.1 time: 0.177381 Aug 04 16:26:17.014089 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 194/385] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:16 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:17.016611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-622464da-c39f-43d3-99eb-64090c4feee1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:17.016611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-622464da-c39f-43d3-99eb-64090c4feee1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:17.023749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-622464da-c39f-43d3-99eb-64090c4feee1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.024181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-622464da-c39f-43d3-99eb-64090c4feee1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.025498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-622464da-c39f-43d3-99eb-64090c4feee1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.025931 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-622464da-c39f-43d3-99eb-64090c4feee1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.083963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cc6efe71-756f-419d-a1e9-1f6230d4fb47 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 38109 microversion: 2.20 time: 0.112380 Aug 04 16:26:17.085147 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 192/386] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:26:16 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 38109 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:17.092211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b22d8ec5-6833-4155-b641-b83b448f6819 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb3afabe-9cb8-44ba-b958-9b25f35f2127"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:17.093372 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b22d8ec5-6833-4155-b641-b83b448f6819 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:17.102156 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b22d8ec5-6833-4155-b641-b83b448f6819 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.102606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b22d8ec5-6833-4155-b641-b83b448f6819 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.103394 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b22d8ec5-6833-4155-b641-b83b448f6819 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.103824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b22d8ec5-6833-4155-b641-b83b448f6819 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.131249 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-622464da-c39f-43d3-99eb-64090c4feee1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 37519 microversion: 2.1 time: 0.122380 Aug 04 16:26:17.132099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 195/387] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:17 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 37519 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:17.371654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-957b31c3-9090-4c0c-b86f-4ac7fb2fbc1f req-a5a730b4-1c4f-4b4f-b711-fb9cd9be1d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3331178-18f4-4522-881b-8c6df0e12099", "tag": "838da6dd-870a-49b9-bc2a-1d856d9ae817"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:17.373316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:17.373316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:17.381373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-957b31c3-9090-4c0c-b86f-4ac7fb2fbc1f req-a5a730b4-1c4f-4b4f-b711-fb9cd9be1d6c service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.382120 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-957b31c3-9090-4c0c-b86f-4ac7fb2fbc1f req-a5a730b4-1c4f-4b4f-b711-fb9cd9be1d6c service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.398778 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-957b31c3-9090-4c0c-b86f-4ac7fb2fbc1f req-a5a730b4-1c4f-4b4f-b711-fb9cd9be1d6c service nova] Creating event network-changed:838da6dd-870a-49b9-bc2a-1d856d9ae817 for instance e3331178-18f4-4522-881b-8c6df0e12099 on hv-cinder-78956 Aug 04 16:26:17.405626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-957b31c3-9090-4c0c-b86f-4ac7fb2fbc1f req-a5a730b4-1c4f-4b4f-b711-fb9cd9be1d6c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037846 Aug 04 16:26:17.406697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 196/388] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:26:17.419120 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b22d8ec5-6833-4155-b641-b83b448f6819 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331720 Aug 04 16:26:17.420700 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 193/389] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:26:17 2021] POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:17.658350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:17.659054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:17.665515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.666240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.667018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.667426 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.795362 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:17.803782 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3e63b41a-c71c-442e-aba1-4835503fcfc9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.149128 Aug 04 16:26:17.806040 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 197/390] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:17 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:17.840176 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:17.841063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:17.852353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.853142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.854084 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.854627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.986837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:17.987449 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:17.995028 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.995784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:17.996428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:17.996935 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.151153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:18.158729 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-55b3e449-9e26-4fac-ad83-4dc9a80cb2ce tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.176370 Aug 04 16:26:18.159288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 198/391] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:17 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:18.163999 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1c528a34-573e-44b9-a8c0-c447b0e19092 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:18.165347 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1c528a34-573e-44b9-a8c0-c447b0e19092 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:18.165812 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:18.173233 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c528a34-573e-44b9-a8c0-c447b0e19092 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.173675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c528a34-573e-44b9-a8c0-c447b0e19092 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.174748 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c528a34-573e-44b9-a8c0-c447b0e19092 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.175386 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c528a34-573e-44b9-a8c0-c447b0e19092 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.177453 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cec64258-5a44-4981-ae4f-9e70349c9b27 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.341628 Aug 04 16:26:18.186725 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 194/392] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:17 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:18.200722 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c835fe76-9b5e-4737-b544-89a109c7ad44 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:18.201708 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c835fe76-9b5e-4737-b544-89a109c7ad44 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:18.208298 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c835fe76-9b5e-4737-b544-89a109c7ad44 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.208826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c835fe76-9b5e-4737-b544-89a109c7ad44 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.209595 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c835fe76-9b5e-4737-b544-89a109c7ad44 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.210066 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c835fe76-9b5e-4737-b544-89a109c7ad44 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.267975 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1c528a34-573e-44b9-a8c0-c447b0e19092 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 200 len: 38242 microversion: 2.20 time: 0.107147 Aug 04 16:26:18.268544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 199/393] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:26:18 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 38242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:18.280272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f3e384e6-485c-4499-b051-f2b95eb43e29 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:18.280957 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f3e384e6-485c-4499-b051-f2b95eb43e29 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:18.288856 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3e384e6-485c-4499-b051-f2b95eb43e29 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.289394 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3e384e6-485c-4499-b051-f2b95eb43e29 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.290311 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3e384e6-485c-4499-b051-f2b95eb43e29 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.290824 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f3e384e6-485c-4499-b051-f2b95eb43e29 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.301376 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c835fe76-9b5e-4737-b544-89a109c7ad44 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 37996 microversion: 2.1 time: 0.106266 Aug 04 16:26:18.302298 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 195/394] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:18 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 37996 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:18.324138 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f3e384e6-485c-4499-b051-f2b95eb43e29 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/ips" status: 200 len: 152 microversion: 2.20 time: 0.047946 Aug 04 16:26:18.324926 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 200/395] 10.222.0.77 () {60 vars in 1289 bytes} [Wed Aug 4 16:26:18 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:18.826908 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:18.827503 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:18.835858 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.836395 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:18.837327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:18.837823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.112923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:19.121147 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6e5d91b6-6977-4fc7-926c-8aa5af7dee6e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.300881 Aug 04 16:26:19.121748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 196/396] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:18 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:19.175729 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:19.177584 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:19.189755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.190394 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.191295 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.191877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.193580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:19.194456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:19.204266 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.204717 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.205498 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.205925 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.333494 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:19.341866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2801f458-8b9b-4fe1-b96c-7152c614c0b9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.169786 Aug 04 16:26:19.342473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 201/397] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:19 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:19.347155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-129fa894-1e94-420f-97e2-4cbce9821c2f req-6b3414cd-7248-428b-9388-84a1e5abbdeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc4cbe9-9ab3-4a0f-8e98-af6face4a038", "name": "network-vif-plugged", "status": "completed", "tag": "25c02836-f5d3-4db9-bfb6-3cfc493da78c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:19.349045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:19.349045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:19.356146 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-129fa894-1e94-420f-97e2-4cbce9821c2f req-6b3414cd-7248-428b-9388-84a1e5abbdeb service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.356584 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-129fa894-1e94-420f-97e2-4cbce9821c2f req-6b3414cd-7248-428b-9388-84a1e5abbdeb service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.376544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-129fa894-1e94-420f-97e2-4cbce9821c2f req-6b3414cd-7248-428b-9388-84a1e5abbdeb service nova] Creating event network-vif-plugged:25c02836-f5d3-4db9-bfb6-3cfc493da78c for instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 on hv-cinder-78956 Aug 04 16:26:19.381537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-129fa894-1e94-420f-97e2-4cbce9821c2f req-6b3414cd-7248-428b-9388-84a1e5abbdeb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037702 Aug 04 16:26:19.382186 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 202/398] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:19.387718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b96b8988-fc2a-46aa-9777-1270aa0665c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:19.388713 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b96b8988-fc2a-46aa-9777-1270aa0665c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:19.395396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b96b8988-fc2a-46aa-9777-1270aa0665c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.395834 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b96b8988-fc2a-46aa-9777-1270aa0665c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.396619 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b96b8988-fc2a-46aa-9777-1270aa0665c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.397178 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b96b8988-fc2a-46aa-9777-1270aa0665c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.411354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:19.419890 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ded2980a-d74c-4f2f-821f-ad24d34a970c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.230159 Aug 04 16:26:19.420593 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 197/399] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:19 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:19.426257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-ec32e9f0-9902-4eef-939f-3ca62fd9a9c5 req-53a43c15-c8d9-4fc7-af18-2b9284b943ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac01ba44-a812-49b3-b86e-9c48dda7d321", "tag": "2f98095a-4190-47cd-bc6f-386032999d1c"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:19.428677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:19.428677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:26:19.437940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-ec32e9f0-9902-4eef-939f-3ca62fd9a9c5 req-53a43c15-c8d9-4fc7-af18-2b9284b943ae service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:19.438493 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-ec32e9f0-9902-4eef-939f-3ca62fd9a9c5 req-53a43c15-c8d9-4fc7-af18-2b9284b943ae service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:19.451238 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-ec32e9f0-9902-4eef-939f-3ca62fd9a9c5 req-53a43c15-c8d9-4fc7-af18-2b9284b943ae service nova] Creating event network-changed:2f98095a-4190-47cd-bc6f-386032999d1c for instance ac01ba44-a812-49b3-b86e-9c48dda7d321 on hv-cinder-78956 Aug 04 16:26:19.456122 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-ec32e9f0-9902-4eef-939f-3ca62fd9a9c5 req-53a43c15-c8d9-4fc7-af18-2b9284b943ae service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034152 Aug 04 16:26:19.456774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 198/400] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:19.498390 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b96b8988-fc2a-46aa-9777-1270aa0665c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 38116 microversion: 2.1 time: 0.114322 Aug 04 16:26:19.499390 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 203/401] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:19 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 38116 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:20.141383 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:20.142514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:20.151711 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.152157 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.152947 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.153392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.288649 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:20.296509 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-20b268e6-9cc2-4e01-bdee-582094139c93 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.159662 Aug 04 16:26:20.297086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 199/402] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:20 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:20.359599 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:20.360280 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:20.367089 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.367530 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.368286 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.368708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.437209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:20.437783 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:20.444165 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.444614 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.445402 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.445831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.503502 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:20.516313 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-88173e4d-3518-4c54-8e45-95b60bd9eba6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.160702 Aug 04 16:26:20.516905 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 204/403] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:20 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:20.523462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ee46198e-ed78-461d-8373-f6bc57b19a1e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:20.524704 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ee46198e-ed78-461d-8373-f6bc57b19a1e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:20.532127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee46198e-ed78-461d-8373-f6bc57b19a1e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.532560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee46198e-ed78-461d-8373-f6bc57b19a1e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.533343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee46198e-ed78-461d-8373-f6bc57b19a1e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.533771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee46198e-ed78-461d-8373-f6bc57b19a1e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.578662 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:20.586420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1734bd85-054b-4c4a-bfe1-723d3ab2c075 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1357 microversion: 2.1 time: 0.153098 Aug 04 16:26:20.586990 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 200/404] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:20 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:20.615287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ee46198e-ed78-461d-8373-f6bc57b19a1e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 200 len: 38230 microversion: 2.1 time: 0.096417 Aug 04 16:26:20.615945 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 205/405] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:20 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 38230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:26:20.625703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-636eec8c-c800-4d5d-9ba4-96e80bd165a0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:20.626224 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-636eec8c-c800-4d5d-9ba4-96e80bd165a0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:20.633003 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-636eec8c-c800-4d5d-9ba4-96e80bd165a0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.633452 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-636eec8c-c800-4d5d-9ba4-96e80bd165a0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.634258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-636eec8c-c800-4d5d-9ba4-96e80bd165a0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.634690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-636eec8c-c800-4d5d-9ba4-96e80bd165a0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.659778 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-636eec8c-c800-4d5d-9ba4-96e80bd165a0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/ips" status: 200 len: 145 microversion: 2.1 time: 0.037673 Aug 04 16:26:20.660451 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 201/406] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 4 16:26:20 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:20.859839 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:20.860361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:20.867615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.868056 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.868836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:20.869272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:20.893576 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lazy-loading 'flavor' on Instance uuid 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:26:21.206732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-babf0e31-1a18-4b90-8716-6047a1caa259 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 202 len: 0 microversion: 2.20 time: 0.350881 Aug 04 16:26:21.211693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 206/407] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:26:20 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:26:21.221059 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:21.221059 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:21.224101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.224542 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.226228 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.226834 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.318006 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:21.318332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:21.334729 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.336348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.336582 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.337215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.374708 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.399197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.402836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.405237 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-324843d4-5292-4f2c-942a-2ddde4160526 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.192043 Aug 04 16:26:21.407635 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 202/408] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:21 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:21.486229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.493816 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-78b09496-3678-4e93-a140-72c8c5c82516 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.181921 Aug 04 16:26:21.494504 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 207/409] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:21 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:21.532636 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:21.533416 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:21.541114 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.541557 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.542799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.543393 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.602651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:21.603283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:21.609616 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.610084 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.610856 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.611282 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.673115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.688179 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a0215f6f-4a17-4e55-8931-f3e9e93b3185 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.158921 Aug 04 16:26:21.689019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 203/410] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:21 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:21.741029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.748598 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-aa4da59c-b5fb-4b91-84b5-294755dbb561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1547 microversion: 2.1 time: 0.149807 Aug 04 16:26:21.749512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 208/411] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:21 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:21.766157 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:21.766761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:21.773655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.774151 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.774923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.775345 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.904607 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.912655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-039390ec-c090-4989-92a6-c493c4d9d5f1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1547 microversion: 2.1 time: 0.150381 Aug 04 16:26:21.913200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 204/412] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:21 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:21.928262 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:21.931703 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:21.931703 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:21.932683 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:21.933419 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Searching by: {'deleted': False, 'project_id': 'c5b483243f1443f891eee772089355e6'} {{(pid=107559) get_all /opt/stack/nova/nova/compute/api.py:2833}} Aug 04 16:26:21.940599 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.941032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:21.941930 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:21.942386 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.033868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.multi_cell_list [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 04 16:26:22.141415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-21667e69-6eaa-40c8-8d16-a67acbb63c79 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216904 Aug 04 16:26:22.142288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 209/413] 10.222.0.77 () {58 vars in 1125 bytes} [Wed Aug 4 16:26:21 2021] GET /compute/v2.1/servers => generated 342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:22.153794 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:22.154454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:22.161626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.162120 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.162865 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.163291 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.304808 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:22.312831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d31cb994-e3cb-4938-bfbb-ac401f8fc561 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1547 microversion: 2.1 time: 0.163331 Aug 04 16:26:22.314951 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 205/414] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:22 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:22.433782 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:22.434472 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:22.443737 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.444327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.445237 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.445775 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.510955 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:22.512058 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:22.520010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.520559 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.521351 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.521784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.627841 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:22.637634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:22.639511 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:22.640824 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e032107f-22f0-442d-86ea-59cdbadfe59b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.211228 Aug 04 16:26:22.641855 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 210/415] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:22 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:22.696082 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:22.708518 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-53476c01-c1d9-4ef9-8a7f-0bd79f950d84 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.200158 Aug 04 16:26:22.709872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:22.710401 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:22.711125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 206/416] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:22 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:22.725591 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.726061 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.727892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:22.728823 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:22.870887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:22.880694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b3a2ad5c-a671-4da4-a221-851b6352839a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.177325 Aug 04 16:26:22.881701 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 211/417] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:22 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:23.662760 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:23.663447 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:23.669665 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.670142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:23.670910 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.671347 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:23.727566 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:23.728160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:23.734617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.735075 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:23.735847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.736263 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:23.820112 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:23.833353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:23.834796 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:23.835967 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-95f69542-34f7-4fa5-8269-f956f284501b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.177397 Aug 04 16:26:23.836531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 207/418] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:23 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:23.841071 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bf7cb2d2-1e04-406e-a465-2759a7c23389 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edc01946-afa3-46a7-954b-19605177f7ad"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:23.842198 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bf7cb2d2-1e04-406e-a465-2759a7c23389 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:23.852014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bf7cb2d2-1e04-406e-a465-2759a7c23389 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.852742 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bf7cb2d2-1e04-406e-a465-2759a7c23389 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:23.854426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bf7cb2d2-1e04-406e-a465-2759a7c23389 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.854949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bf7cb2d2-1e04-406e-a465-2759a7c23389 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:23.941199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:23.949851 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4040ddb0-bdf8-4013-a772-5fa5a8308d1c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.225932 Aug 04 16:26:23.954088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 212/419] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:23 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:23.957465 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:23.958515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:23.964693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.965242 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:23.965907 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:23.966405 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:24.123196 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:24.131531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-680a7529-1f47-4c52-a0a5-7abbf542dc84 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.178902 Aug 04 16:26:24.132111 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 213/420] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:23 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:24.137185 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-94c5ae1f-c22c-4997-a180-0018834df06b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac9a9522-c983-4dd8-95ad-71eb99d28025"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:24.138344 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-94c5ae1f-c22c-4997-a180-0018834df06b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:24.144497 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-94c5ae1f-c22c-4997-a180-0018834df06b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:24.145468 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-94c5ae1f-c22c-4997-a180-0018834df06b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:24.146318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-94c5ae1f-c22c-4997-a180-0018834df06b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:24.146606 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-94c5ae1f-c22c-4997-a180-0018834df06b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:24.194918 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bf7cb2d2-1e04-406e-a465-2759a7c23389 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356859 Aug 04 16:26:24.195599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 208/421] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:26:23 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:24.456068 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-94c5ae1f-c22c-4997-a180-0018834df06b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322439 Aug 04 16:26:24.456854 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 214/422] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:26:24 2021] POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:24.854093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:24.854678 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:24.861254 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:24.861701 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:24.862556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:24.862945 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:24.973574 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:24.974299 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:24.981015 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:24.981738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:24.982639 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:24.983083 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:24.995768 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:25.004370 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:25.005891 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:25.007095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-aa8a2605-576a-4be9-a4e9-9ad388df66d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.157313 Aug 04 16:26:25.007704 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 209/423] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:24 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:25.021561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:25.023621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:25.038825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:25.039362 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:25.040199 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:25.040845 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:25.065929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lazy-loading 'flavor' on Instance uuid 64b045ab-defa-4f38-8178-9d493b95c21c {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:26:25.144943 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:25.152765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5da570ae-ccd2-4d0c-bd7b-a3f6eace637e tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.184774 Aug 04 16:26:25.153345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 215/424] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:24 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:25.158396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:25.159005 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:25.165553 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:25.166042 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:25.166881 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:25.167344 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:25.230335 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8fa79fe2-2d12-4519-963e-95303b613efc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action" status: 200 len: 32 microversion: 2.1 time: 0.221226 Aug 04 16:26:25.231195 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 210/425] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:25 2021] POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:26:25.240980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:25.241677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:25.249062 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:25.249586 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:25.250612 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:25.251107 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:25.364745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:25.372315 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c6419d67-f910-4938-8103-580906b6cff1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.217921 Aug 04 16:26:25.382379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 216/426] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:25 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:25.387512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-67d9334d-557a-4d21-9cfc-3ed795860b9d req-72fde1a0-6ba3-42ab-baab-d99b10ed03cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac01ba44-a812-49b3-b86e-9c48dda7d321", "name": "network-vif-plugged", "status": "completed", "tag": "2f98095a-4190-47cd-bc6f-386032999d1c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:25.389277 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:25.389277 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:25.402021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-67d9334d-557a-4d21-9cfc-3ed795860b9d req-72fde1a0-6ba3-42ab-baab-d99b10ed03cc service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:25.402504 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-67d9334d-557a-4d21-9cfc-3ed795860b9d req-72fde1a0-6ba3-42ab-baab-d99b10ed03cc service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:25.418901 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-67d9334d-557a-4d21-9cfc-3ed795860b9d req-72fde1a0-6ba3-42ab-baab-d99b10ed03cc service nova] Creating event network-vif-plugged:2f98095a-4190-47cd-bc6f-386032999d1c for instance ac01ba44-a812-49b3-b86e-9c48dda7d321 on hv-cinder-78956 Aug 04 16:26:25.423627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-67d9334d-557a-4d21-9cfc-3ed795860b9d req-72fde1a0-6ba3-42ab-baab-d99b10ed03cc service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039743 Aug 04 16:26:25.424699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 217/427] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:25.539723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:25.554762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fd68f823-3b03-4cb3-be94-ad689cce726e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.318229 Aug 04 16:26:25.564852 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 211/428] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:25 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:26.028069 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:26.028777 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:26.035639 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.036399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.037191 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.037620 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.170598 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:26.171274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:26.176596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:26.182683 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.183128 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.183919 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.184530 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.185017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:26.186669 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:26.187677 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-dbf6bd2f-6723-447b-a5ea-65c792d285e9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.164078 Aug 04 16:26:26.188222 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 218/429] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:26 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:26.321141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:26.329283 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c2da5480-898a-4ad2-933b-507797e688a1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1318 microversion: 2.1 time: 0.162488 Aug 04 16:26:26.329913 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 212/430] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:26 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:26.388618 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:26.389338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:26.397580 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.398116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.399391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.399915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.543075 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:26.550471 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3e609ec5-3adf-4317-90a4-f3f81ff36f6a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.165583 Aug 04 16:26:26.551088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 219/431] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:26 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:26.572100 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:26.572818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:26.579177 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.579623 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.580398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:26.580833 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:26.714504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:26.723643 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-40eb3657-ef72-4ba0-b2d0-cfac579df848 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.155572 Aug 04 16:26:26.724470 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 213/432] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:26 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:27.207084 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:27.208459 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:27.215097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.215541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.216308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.216736 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.348200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:27.348835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:27.355542 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:27.359862 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.360319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.361247 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.361819 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.363871 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:27.365552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:27.366607 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9348f0ae-3e38-48b6-bbb3-ccc5c32cd11b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.163594 Aug 04 16:26:27.367178 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 220/433] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:27 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:27.441517 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-e32731e8-f0ce-4f02-a51a-83b529f7e784 req-91940585-4f63-4865-95b3-f3c5fff5e1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3331178-18f4-4522-881b-8c6df0e12099", "name": "network-vif-plugged", "status": "completed", "tag": "838da6dd-870a-49b9-bc2a-1d856d9ae817"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:27.443937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:27.443937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:27.452590 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-e32731e8-f0ce-4f02-a51a-83b529f7e784 req-91940585-4f63-4865-95b3-f3c5fff5e1fd service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.452590 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-e32731e8-f0ce-4f02-a51a-83b529f7e784 req-91940585-4f63-4865-95b3-f3c5fff5e1fd service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.465711 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-e32731e8-f0ce-4f02-a51a-83b529f7e784 req-91940585-4f63-4865-95b3-f3c5fff5e1fd service nova] Creating event network-vif-plugged:838da6dd-870a-49b9-bc2a-1d856d9ae817 for instance e3331178-18f4-4522-881b-8c6df0e12099 on hv-cinder-78956 Aug 04 16:26:27.471477 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-e32731e8-f0ce-4f02-a51a-83b529f7e784 req-91940585-4f63-4865-95b3-f3c5fff5e1fd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033626 Aug 04 16:26:27.472615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 221/434] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:26:27.494490 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:27.508288 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8972c574-bf11-43ff-9bfb-f5899ac1c3ca tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1508 microversion: 2.1 time: 0.163183 Aug 04 16:26:27.509513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 214/435] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:27 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:27.569259 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:27.570065 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:27.576730 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.577170 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.577930 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.578387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.718530 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:27.729272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1b13c500-9b17-4466-ae27-1ae31023bf02 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.164027 Aug 04 16:26:27.730414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 222/436] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:27 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:27.741803 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:27.742535 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:27.749626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.750113 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.751157 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:27.751732 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:27.915986 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:27.924929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-481732ba-2547-41de-9cae-3de337335492 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.188081 Aug 04 16:26:27.925737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 215/437] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:27 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:28.385350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:28.385999 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:28.392748 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.393203 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:28.393982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.394452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:28.532951 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:28.543142 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:28.544658 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:28.545824 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-46b40fea-2357-40ac-b85a-4dae627fb5df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.164282 Aug 04 16:26:28.546418 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 223/438] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:28 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:28.748797 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:28.749408 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:28.757793 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.758278 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:28.759066 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.759496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:28.901609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:28.913893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2a789a73-de54-489b-9d98-6289e1085891 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.169497 Aug 04 16:26:28.915283 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 216/439] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:28 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:28.947346 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:28.948569 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:28.973717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.973717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:28.973717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.973717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:28.977006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a6faf06e-4759-4054-a7a6-c3c75afdbe11 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62c54318-2e40-4c98-8dd4-0b637afc909a"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:28.978197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a6faf06e-4759-4054-a7a6-c3c75afdbe11 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:28.988521 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a6faf06e-4759-4054-a7a6-c3c75afdbe11 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.988970 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a6faf06e-4759-4054-a7a6-c3c75afdbe11 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:28.989870 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a6faf06e-4759-4054-a7a6-c3c75afdbe11 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:28.990366 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a6faf06e-4759-4054-a7a6-c3c75afdbe11 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:29.110116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:29.119652 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-481d8965-4cab-45c3-943a-cbb27ad998b2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.178640 Aug 04 16:26:29.120254 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 224/440] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:28 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:29.305073 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a6faf06e-4759-4054-a7a6-c3c75afdbe11 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "POST /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330922 Aug 04 16:26:29.305073 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 217/441] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:26:28 2021] POST /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:29.565334 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:29.566388 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:29.574953 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:29.576093 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:29.576895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:29.577292 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:29.712365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:29.721416 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:29.723018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:29.724671 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5b390960-b157-4498-83d2-6c2473d0ed6e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.164385 Aug 04 16:26:29.725429 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 225/442] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:29 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:29.934327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:29.935022 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:29.943632 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:29.944241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:29.945162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:29.945687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:30.093513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:30.102625 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f0217ba0-e4ca-4c49-9147-a6e792c8cbbb tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.172405 Aug 04 16:26:30.103209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 218/443] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:29 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:30.137530 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:30.138194 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:30.144600 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:30.145035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:30.146187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:30.146410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:30.281518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:30.290972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2953cbd3-7fd0-4c67-aa32-8d4ff242bbdf tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.157148 Aug 04 16:26:30.291560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 226/444] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:30 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:30.744625 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:30.745334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:30.753367 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:30.754040 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:30.755163 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:30.756218 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:30.902233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:30.911274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:30.913008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:30.914191 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6de478b5-4d67-44b2-a433-42102b98f0e1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.173346 Aug 04 16:26:30.914771 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 219/445] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:30 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:26:31.119864 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:31.120489 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:31.136498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:31.136940 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:31.137739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:31.138199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:31.294074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:31.301820 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-eab95add-d4a2-4723-b44f-f71abee0d6b1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1314 microversion: 2.1 time: 0.185641 Aug 04 16:26:31.302481 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 227/446] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:31 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:31.309855 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:31.310717 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:31.325321 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:31.325859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:31.326686 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:31.327119 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:31.488159 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:31.497319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2ca04a0a-ee39-42a1-be0a-8771a83d704d tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.192377 Aug 04 16:26:31.497922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 220/447] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:31 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:31.934804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:31.935410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:31.943845 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:31.945150 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:31.946270 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:31.947000 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:32.123006 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:32.132446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:32.133927 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:32.135085 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8b219da8-8a22-4c50-996f-4555d5160962 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.204973 Aug 04 16:26:32.135668 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 228/448] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:31 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:32.319705 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:32.320258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:32.326653 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:32.327192 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:32.328007 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:32.328411 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:32.464125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:32.471980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-254b40d7-dc77-4855-b385-1d51076ad832 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1499 microversion: 2.1 time: 0.156388 Aug 04 16:26:32.472571 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 221/449] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:32 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:32.516445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:32.517052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:32.523568 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:32.523992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:32.524806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:32.525197 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:32.661820 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:32.673022 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b2ad6f23-1a73-4f03-b434-53ba58e8f88f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.160161 Aug 04 16:26:32.673642 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 229/450] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:32 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:32.826900 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e347a014-57cf-48de-819e-81b750f8e6bf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:32.834832 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e347a014-57cf-48de-819e-81b750f8e6bf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:32.835287 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e347a014-57cf-48de-819e-81b750f8e6bf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:32.898888 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e347a014-57cf-48de-819e-81b750f8e6bf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Going to try to stop instance {{(pid=107558) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 04 16:26:32.946377 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e347a014-57cf-48de-819e-81b750f8e6bf tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 202 len: 0 microversion: 2.1 time: 0.123310 Aug 04 16:26:32.946985 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 222/451] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:32 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:32.955255 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:32.956158 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:32.962919 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:32.963352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:32.964338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:32.964762 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.074273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:33.074932 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:33.081204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.081664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.083072 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.083504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.102462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:33.111802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-999f02a2-e45c-49da-be85-43521959b4ef tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.160101 Aug 04 16:26:33.112452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 230/452] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:32 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:33.117183 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:26:33.156725 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:33.157333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:33.163875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.164316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.165081 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.165503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.229647 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e8c2e9b2-2eb5-4f1d-a224-ba7c74cef07d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 204 len: 0 microversion: 2.1 time: 0.158872 Aug 04 16:26:33.235025 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 223/453] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:26:33 2021] DELETE /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:26:33.241010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:33.241738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:33.248319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.248761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.249703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.250170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.329499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:33.339614 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:33.341099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:33.342324 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8da2f4e3-55d2-4415-8b3d-8af2bc3446c5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.189284 Aug 04 16:26:33.342900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 231/454] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:33 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:33.396030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:33.403913 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-264ffed1-0803-4114-86cb-1d676925ac2e tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1505 microversion: 2.1 time: 0.167438 Aug 04 16:26:33.404501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 224/455] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:33 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:33.691472 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:33.692076 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:33.699696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.700212 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.701001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:33.701435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:33.840984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:33.850584 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-edc2dc26-f48c-4f2a-96c8-25755dcbc3d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.162758 Aug 04 16:26:33.851172 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 232/456] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:33 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:34.130963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:34.131602 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:34.138296 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.138746 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:34.139521 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.139931 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:34.273901 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:34.285874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5900cd21-6478-4d7a-8efd-73891ee1b68f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.159598 Aug 04 16:26:34.286644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 225/457] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:34 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:34.362747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:34.363561 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:34.369917 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.370394 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:34.371174 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.371602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:34.424485 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:34.425558 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:34.437129 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.437942 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:34.439412 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.440198 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:34.511804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:34.521513 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:34.523809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:34.524657 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-07d0460b-fcd2-4ce2-9e0d-d7763869c3a5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.165726 Aug 04 16:26:34.525180 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 233/458] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:34 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:34.595509 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:34.603923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-219cb373-e108-440f-9121-5d9dcc0fee44 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1505 microversion: 2.1 time: 0.186501 Aug 04 16:26:34.604515 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 226/459] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:34 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:34.868399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:34.869001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:34.875902 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.876499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:34.877554 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:34.878198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:35.018899 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:35.027624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-43ec22c8-e20f-4ddc-8f93-73014aa692e4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.163055 Aug 04 16:26:35.028236 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 234/460] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:34 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:35.304643 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:35.306256 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:35.312642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:35.313089 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:35.313980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:35.314330 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:35.455737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:35.467436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5f3a4f5e-0c22-41db-8d74-f9727838981d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.167214 Aug 04 16:26:35.468429 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 227/461] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:35 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:35.547770 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:35.548690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:35.556078 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:35.556719 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:35.557762 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:35.558219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:35.624848 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:35.625473 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:35.633385 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:35.633735 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:35.634894 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:35.635012 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:35.715565 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:35.725185 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:35.726966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:35.728445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ad589b55-b500-4b55-aab6-66063810101c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.186278 Aug 04 16:26:35.729283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 235/462] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:35 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:35.839824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:35.848289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-625de641-a806-4ce2-a1c5-d3c7a76beb26 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1505 microversion: 2.1 time: 0.229254 Aug 04 16:26:35.848888 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 228/463] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:35 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:36.046829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:36.047980 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:36.056032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.056633 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.057399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.057876 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.125017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-0d1ed66c-94c0-4a5f-a01a-85e435a17962 req-3166b4b1-64cf-4a9b-b181-4a5735de2ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3331178-18f4-4522-881b-8c6df0e12099", "name": "network-vif-deleted", "tag": "838da6dd-870a-49b9-bc2a-1d856d9ae817"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:36.128002 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:36.128002 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:26:36.136522 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-0d1ed66c-94c0-4a5f-a01a-85e435a17962 req-3166b4b1-64cf-4a9b-b181-4a5735de2ea0 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.137112 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-0d1ed66c-94c0-4a5f-a01a-85e435a17962 req-3166b4b1-64cf-4a9b-b181-4a5735de2ea0 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.150400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-0d1ed66c-94c0-4a5f-a01a-85e435a17962 req-3166b4b1-64cf-4a9b-b181-4a5735de2ea0 service nova] Creating event network-vif-deleted:838da6dd-870a-49b9-bc2a-1d856d9ae817 for instance e3331178-18f4-4522-881b-8c6df0e12099 on hv-cinder-78956 Aug 04 16:26:36.155314 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-0d1ed66c-94c0-4a5f-a01a-85e435a17962 req-3166b4b1-64cf-4a9b-b181-4a5735de2ea0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034077 Aug 04 16:26:36.156321 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 229/464] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:36.199982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:36.210314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fe8354e7-2bc5-42e0-a69d-64375ec01172 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.168200 Aug 04 16:26:36.210944 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 236/465] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:36 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:36.487057 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:36.487741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:36.495754 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.496197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.496962 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.497394 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.636562 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:36.647439 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-473f4215-7df7-4e3f-93d8-4b7fa4a9108a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.164425 Aug 04 16:26:36.648022 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 230/466] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:36 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:36.746883 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:36.747471 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:36.754124 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.754600 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.755435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.755866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.864357 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:36.865041 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:36.871389 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.871923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.872713 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.873140 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.908834 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:36.917247 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:36.918759 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:36.920134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d95a7576-20fc-4a0b-a2b4-8b873e190a62 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.177202 Aug 04 16:26:36.920688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 237/467] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:36 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:36.931930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:36.932477 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:36.933490 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lazy-loading 'fault' on Instance uuid e3331178-18f4-4522-881b-8c6df0e12099 {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:26:36.985258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:36.993153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d28aa9e5-d1b5-4123-a4a5-1315a2bf262a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 200 len: 1304 microversion: 2.1 time: 0.132418 Aug 04 16:26:36.993743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 231/468] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:36 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:37.227126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:37.227727 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:37.234226 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:37.234667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:37.235431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:37.235855 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:37.370139 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:37.379484 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1ec8d39e-6d86-463a-a0c6-07beb91e2487 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.156167 Aug 04 16:26:37.380242 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 238/469] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:37 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:37.664624 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:37.665244 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:37.672175 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:37.672628 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:37.673420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:37.673842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:37.817698 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:37.826355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0ac81de8-1891-4241-a6fb-59111b2b7cd9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.165620 Aug 04 16:26:37.826952 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 232/470] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:37 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:37.939460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:37.940052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:37.948370 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:37.948939 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:37.950116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:37.950879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.013394 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:38.014106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: e3331178-18f4-4522-881b-8c6df0e12099] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:38.020400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.021554 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.022475 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.022986 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.038029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] HTTP exception thrown: Instance e3331178-18f4-4522-881b-8c6df0e12099 could not be found. Aug 04 16:26:38.038752 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Returning 404 to user: Instance e3331178-18f4-4522-881b-8c6df0e12099 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:26:38.039502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-461eac7c-df6b-4345-bcea-d718f3eab387 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099" status: 404 len: 111 microversion: 2.1 time: 0.030120 Aug 04 16:26:38.040063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 233/471] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:38 2021] GET /compute/v2.1/servers/e3331178-18f4-4522-881b-8c6df0e12099 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:26:38.094532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:38.094722 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-916987095", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "8b73dbfa-1915-4d59-aa47-d7f3a2d43c66"}]}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:38.103932 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:38.105579 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:38.106745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fb13368a-602d-456f-b7bd-3cb798d29009 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.171406 Aug 04 16:26:38.107332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 239/472] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:37 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:38.158326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] validate_networks() for [('8b73dbfa-1915-4d59-aa47-d7f3a2d43c66', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:26:38.396626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:38.397164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:38.403540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.404001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.404765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.405207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.537011 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:38.544303 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:26:38.544727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:26:38.545201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:26:38.545601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:26:38.546249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:26:38.551986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6005d092-8cdb-4b83-aa6b-65330a59f341 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.159365 Aug 04 16:26:38.553166 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 240/473] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:38 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:38.556589 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.557040 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.557895 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.558326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.578846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Getting quotas for project 5415912273de496e963a7c07ee381732. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:26:38.583329 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Getting quotas for user 39928789024c475ca0ffa42106b2f3fe and project 5415912273de496e963a7c07ee381732. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:26:38.594962 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:26:38.597267 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:26:38.645201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3276ecf3-bacd-4cd8-8865-9c952327c153 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554032 Aug 04 16:26:38.646086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 234/474] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:26:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:26:38.656986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5149fc67-4e3e-45b9-9173-249281c8ce23 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:38.657603 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5149fc67-4e3e-45b9-9173-249281c8ce23 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:38.717084 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5149fc67-4e3e-45b9-9173-249281c8ce23 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:38.729543 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5149fc67-4e3e-45b9-9173-249281c8ce23 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1213 microversion: 2.1 time: 0.076816 Aug 04 16:26:38.730513 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 241/475] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:38 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:38.845474 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:38.846591 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:38.853669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.854148 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:38.854930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:38.855538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.017370 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:39.030287 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0874198d-db4f-4feb-8587-29818caf06ac tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.188480 Aug 04 16:26:39.030900 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 235/476] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:38 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:39.124833 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:39.125538 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:39.132343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.132877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.133737 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.134256 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.295516 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:39.305223 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:39.307075 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:39.308318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5e3b339f-9e45-4ddd-8098-b8d4da70dc76 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.187336 Aug 04 16:26:39.308869 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 242/477] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:39 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:39.571031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:39.571548 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:39.579209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.579928 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.581194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.581898 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.744207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:39.746805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:39.747892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:39.752364 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-eb707448-0ea9-47af-84c0-3d494df45cc2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.185507 Aug 04 16:26:39.753019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 236/478] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:39 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:39.753303 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.753751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.754555 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.754984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.777829 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:39.778462 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:39.784751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.785194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.785987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:39.786419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:39.815276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:39.823514 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-74a0d70c-76cb-4205-8f03-352e3e0ec0c9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1265 microversion: 2.1 time: 0.080232 Aug 04 16:26:39.834012 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 243/479] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:39 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:39.928744 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:39.938373 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3a9d36de-5820-4c83-828b-1bd5c65e6b9d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1593 microversion: 2.1 time: 0.164081 Aug 04 16:26:39.938972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 237/480] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:39 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:40.048363 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:40.050021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:40.057134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.063253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:40.066578 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.069321 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:40.224427 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:40.233217 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6c1a0d0b-bf62-4c49-a87c-3fb6f529c9bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.188743 Aug 04 16:26:40.233848 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 244/481] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:40 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:40.334164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:40.335671 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:40.343537 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.344227 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:40.345198 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.345718 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:40.618878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:40.628844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:40.631222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:40.632489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0183a118-37b1-4a31-ba21-b4a5f0a05fbf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.304662 Aug 04 16:26:40.643358 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 238/482] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:40 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:40.769061 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:40.770054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:40.776565 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.777002 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:40.777778 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.778233 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:40.844170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:40.845232 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:40.852508 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.853192 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:40.854674 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:40.855539 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:41.076958 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:41.086430 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7d0a6400-a644-4450-8c86-baa1bbc8bcde tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.321430 Aug 04 16:26:41.087022 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 245/483] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:40 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:41.128106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:41.140999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2e6bbe46-c7be-4fcd-bf00-06fa70f4cee9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.300713 Aug 04 16:26:41.154058 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 239/484] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:40 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:41.255650 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:41.256853 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:41.267641 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:41.268401 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:41.269781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:41.270563 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:41.562219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:41.571627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fb4b548d-17f0-4688-9a00-0ec83628e757 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.323913 Aug 04 16:26:41.572215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 246/485] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:41 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:41.651491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:41.652588 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:41.659124 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:41.659565 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:41.660341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:41.661014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:41.901914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:41.913598 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:41.915602 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:41.917605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b778eb3a-67cc-45a7-b704-f5ba6ac3e349 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.269984 Aug 04 16:26:41.918525 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 240/486] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:41 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:26:42.086532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-c4448f94-839b-461b-9bd6-29866d3fdb16 req-fc47a20e-c909-4293-bfd6-ded4d21ea4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521db769-5cc0-4650-825b-60d2bd65ba8e", "tag": "ab31841b-8c84-4191-8224-14d23e6435ca"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:42.088546 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:42.088546 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:42.097308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-c4448f94-839b-461b-9bd6-29866d3fdb16 req-fc47a20e-c909-4293-bfd6-ded4d21ea4cf service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.098283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-c4448f94-839b-461b-9bd6-29866d3fdb16 req-fc47a20e-c909-4293-bfd6-ded4d21ea4cf service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.104607 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:42.105321 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:42.116460 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.117039 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.122007 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.122007 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.134471 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-c4448f94-839b-461b-9bd6-29866d3fdb16 req-fc47a20e-c909-4293-bfd6-ded4d21ea4cf service nova] Creating event network-changed:ab31841b-8c84-4191-8224-14d23e6435ca for instance 521db769-5cc0-4650-825b-60d2bd65ba8e on hv-cinder-78956 Aug 04 16:26:42.146657 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-c4448f94-839b-461b-9bd6-29866d3fdb16 req-fc47a20e-c909-4293-bfd6-ded4d21ea4cf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064219 Aug 04 16:26:42.149234 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 247/487] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:42.169120 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:42.170553 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:42.186572 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.189734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.191457 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.192542 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.448356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:42.458146 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-919fc7da-50f2-4772-9dad-23afff90ff60 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.356769 Aug 04 16:26:42.459380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 241/488] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:42 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:42.527820 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:42.536466 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-db8bef5b-d955-4394-b84a-f1fca7496dc7 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.377141 Aug 04 16:26:42.546091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 248/489] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:42 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:42.591895 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:42.592652 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:42.601458 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.602179 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.603062 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.603659 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.661739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-270e7de7-6ece-43dd-bb40-2d88109bdd12 req-6d676969-624a-4b7e-baf2-5f9bd86220f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc4cbe9-9ab3-4a0f-8e98-af6face4a038", "tag": "25c02836-f5d3-4db9-bfb6-3cfc493da78c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:42.665560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:42.665560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:42.679749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-270e7de7-6ece-43dd-bb40-2d88109bdd12 req-6d676969-624a-4b7e-baf2-5f9bd86220f5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.680850 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-270e7de7-6ece-43dd-bb40-2d88109bdd12 req-6d676969-624a-4b7e-baf2-5f9bd86220f5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.701345 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-270e7de7-6ece-43dd-bb40-2d88109bdd12 req-6d676969-624a-4b7e-baf2-5f9bd86220f5 service nova] Creating event network-changed:25c02836-f5d3-4db9-bfb6-3cfc493da78c for instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 on hv-cinder-78956 Aug 04 16:26:42.708293 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-270e7de7-6ece-43dd-bb40-2d88109bdd12 req-6d676969-624a-4b7e-baf2-5f9bd86220f5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050989 Aug 04 16:26:42.710335 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 249/490] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:42.860972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:42.870034 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bd94e1fc-af5f-45cc-9924-ad1a43ac8725 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.282444 Aug 04 16:26:42.881057 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 242/491] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:42 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:42.940296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:42.942327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:42.954452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.956392 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:42.958021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:42.959223 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:43.225761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:43.243955 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:43.245560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:43.246807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1821e75c-2e0b-4974-9f6d-ad79fb803baa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1745 microversion: 2.20 time: 0.313231 Aug 04 16:26:43.250965 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 250/492] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:42 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1745 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:43.479921 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:43.480746 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:43.495531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:43.495531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:43.495811 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:43.496315 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:43.558151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:43.558964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:43.581533 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:43.582773 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:43.584115 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:43.584859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:43.785333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:43.800142 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:43.800853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-de81836e-03ba-4bc2-b42c-427942d5963e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.326553 Aug 04 16:26:43.802364 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 243/493] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:43 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:43.821588 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-db8b1ac4-3f3d-47a3-a27e-8b7757d08612 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.268631 Aug 04 16:26:43.824002 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 251/494] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:43 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:43.897637 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:43.898657 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:43.907027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:43.908316 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:43.909294 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:43.910077 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.136538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:44.150431 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-595f5400-f080-437e-af11-b2d08076fcb1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.265993 Aug 04 16:26:44.151325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 244/495] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:43 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:44.178043 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-991765849"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:44.179693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:44.184810 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.185234 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.186035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.186462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.271334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:44.272064 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:44.278533 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.278983 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.279768 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.280426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.315737 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.network.security_group_api [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Adding security group e5a6013c-8210-4748-ba4c-aa2fab3cace6 to port 25c02836-f5d3-4db9-bfb6-3cfc493da78c Aug 04 16:26:44.424875 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:44.434592 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:44.436893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:44.437374 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f9940571-5949-4370-9f46-52a991367435 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1745 microversion: 2.20 time: 0.170080 Aug 04 16:26:44.438587 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 245/496] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:44 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:26:44.747819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c32cac06-004e-4fcc-a302-b95422becfdf tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/action" status: 202 len: 0 microversion: 2.1 time: 0.573763 Aug 04 16:26:44.749762 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 252/497] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:44 2021] POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:44.760182 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:44.760887 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:44.766629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-0cb90053-f9bb-46b2-a658-baf95821a638 req-54693028-c7b8-4575-8bf9-173a33f55eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc4cbe9-9ab3-4a0f-8e98-af6face4a038", "tag": "25c02836-f5d3-4db9-bfb6-3cfc493da78c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:44.767365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.767811 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.768229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:44.768229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:44.768800 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.769236 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.783602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-0cb90053-f9bb-46b2-a658-baf95821a638 req-54693028-c7b8-4575-8bf9-173a33f55eee service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.785744 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-0cb90053-f9bb-46b2-a658-baf95821a638 req-54693028-c7b8-4575-8bf9-173a33f55eee service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.809227 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-0cb90053-f9bb-46b2-a658-baf95821a638 req-54693028-c7b8-4575-8bf9-173a33f55eee service nova] Creating event network-changed:25c02836-f5d3-4db9-bfb6-3cfc493da78c for instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 on hv-cinder-78956 Aug 04 16:26:44.815153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-0cb90053-f9bb-46b2-a658-baf95821a638 req-54693028-c7b8-4575-8bf9-173a33f55eee service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056791 Aug 04 16:26:44.815811 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 253/498] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:44.821819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:44.822902 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:44.833155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.833940 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.834932 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:44.835514 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:44.997294 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:45.005842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:45.006187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d479ad6b-da84-439f-b587-41eb43c42771 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.188006 Aug 04 16:26:45.007314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 254/499] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:44 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:45.012790 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:45.013624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:45.022064 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-676eed58-07b1-4400-ac89-b9bcf5cfaac1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1758 microversion: 2.1 time: 0.267100 Aug 04 16:26:45.027506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 246/500] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:44 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1758 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:45.027693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:45.028004 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:45.028805 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:45.029238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:45.171843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:45.172738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:45.181762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:45.181762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:45.182304 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:45.182613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:45.183528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:45.192589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3854894a-8cb0-47d3-ab54-40fc14bc69b6 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.183326 Aug 04 16:26:45.194391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 255/501] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:45 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:45.375113 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:45.384668 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-017cb104-c10d-41f0-b94b-f74dea8c82db tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.219557 Aug 04 16:26:45.385470 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 247/502] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:45 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:45.459213 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:45.460352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:45.470576 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:45.472173 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:45.473305 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:45.473838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:45.643222 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:45.654114 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:45.656519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:45.659255 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9b0efa62-197c-4c47-a083-74df9c3bcb55 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1745 microversion: 2.20 time: 0.205860 Aug 04 16:26:45.670217 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 256/503] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:45 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1745 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:45.823802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-022d28a2-75b9-4226-b227-cae392dc6841 req-fa324060-6320-4437-a259-acb03900211b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e525871-8d1f-4462-9cb5-7e3aeb9c3977", "name": "network-vif-plugged", "status": "completed", "tag": "0da0ab28-3f37-48ae-94a1-42c44e08a854"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:45.825639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:45.825639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:26:45.833842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-022d28a2-75b9-4226-b227-cae392dc6841 req-fa324060-6320-4437-a259-acb03900211b service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:45.834684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-022d28a2-75b9-4226-b227-cae392dc6841 req-fa324060-6320-4437-a259-acb03900211b service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:45.850586 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-022d28a2-75b9-4226-b227-cae392dc6841 req-fa324060-6320-4437-a259-acb03900211b service nova] Creating event network-vif-plugged:0da0ab28-3f37-48ae-94a1-42c44e08a854 for instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 on hv-cinder-78956 Aug 04 16:26:45.856155 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-022d28a2-75b9-4226-b227-cae392dc6841 req-fa324060-6320-4437-a259-acb03900211b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036285 Aug 04 16:26:45.856775 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 248/504] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:46.023807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:46.024653 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:46.032523 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.033421 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.034813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.035450 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.197862 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:46.206184 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f86ed953-77f2-444b-8454-730ad2149784 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.186243 Aug 04 16:26:46.207380 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 257/505] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:46 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:46.219466 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:46.220090 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:46.226821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.227271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.228056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.228484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.390063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:46.404206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:46.405018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:46.408609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b0ff0f87-47fd-4acb-beb1-620fb63021f1 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.201381 Aug 04 16:26:46.409681 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 249/506] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:46 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:46.412593 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.413189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.418308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.418308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.566758 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:46.577522 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f605fe2f-3df3-4009-800d-c7a203398cc2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.178703 Aug 04 16:26:46.578996 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 258/507] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:46 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:46.678104 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:46.678896 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:46.688183 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.689041 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.690202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.690917 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.756738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:46.758278 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:46.764686 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.765119 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.765681 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:46.766426 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:46.867594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:46.878741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:46.880667 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:46.882047 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-52d7f16a-164d-4309-bb05-554105c002e3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.207891 Aug 04 16:26:46.890086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 250/508] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:46 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:46.946784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lazy-loading 'services' on Instance uuid ac01ba44-a812-49b3-b86e-9c48dda7d321 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:26:47.077417 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9cf5531f-d67a-46ab-b323-307be90fcc5d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321/os-volume_attachments/62c54318-2e40-4c98-8dd4-0b637afc909a" status: 202 len: 0 microversion: 2.1 time: 0.324827 Aug 04 16:26:47.081613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 259/509] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:26:46 2021] DELETE /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321/os-volume_attachments/62c54318-2e40-4c98-8dd4-0b637afc909a => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:26:47.225210 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:47.225370 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:47.231794 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.232453 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:47.233405 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.234153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:47.412554 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:47.420252 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-32750fbf-b9e0-4c65-91e2-096839a57263 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.199923 Aug 04 16:26:47.421108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 251/510] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:47 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:47.431890 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:47.432952 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:47.440063 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.440771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:47.442563 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.443733 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:47.587057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:47.595903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-63ffd468-8ec0-4d65-8de7-bb0a5caa53d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.168849 Aug 04 16:26:47.597194 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 260/511] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:47 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:47.605619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:47.606669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:47.614129 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.615102 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:47.616125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.616616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:47.778011 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:47.788200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-45b9d5ee-14fe-46fd-8caf-7e02323bb194 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.189604 Aug 04 16:26:47.802575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 252/512] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:47 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:47.907784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:47.908615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:47.920539 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.921741 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:47.922802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:47.923307 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:48.092446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:48.102062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:48.104671 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:48.106344 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-03184078-4759-46a7-a8e3-08b84e4aeb8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.207277 Aug 04 16:26:48.107118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 261/513] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:47 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:48.439634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:48.441030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:48.449465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:48.450157 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:48.451030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:48.451727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:48.606197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:48.613023 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:48.614132 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:48.616751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-deaa1ec7-2263-43df-9612-dfc92aa73c78 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.181786 Aug 04 16:26:48.617723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 253/514] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:48 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:48.634026 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:48.634911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:48.635983 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:48.636664 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:48.819442 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:48.820890 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:48.838484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:48.839375 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:48.842404 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:48.843327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:48.898294 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:48.910557 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fea9552e-43c5-4b55-ae54-c0f73dc1e159 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.301375 Aug 04 16:26:48.915747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 262/515] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:48 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:49.040527 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:49.051716 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4273269c-4209-4655-b6a4-051a5f6eee03 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.237671 Aug 04 16:26:49.052567 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 254/516] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:48 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:49.126958 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:49.127631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:49.135320 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:49.136067 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:49.137156 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:49.137788 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:49.307044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:49.317251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:49.324425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:49.325853 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-639c16c0-dbc7-4718-a81b-3b040ebfcf03 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.202728 Aug 04 16:26:49.339257 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 263/517] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:49 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:49.526765 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-bd57fa62-23e8-473b-a733-4b728fe616ab req-aec1ea79-6eaa-439d-9e26-6de6b10039be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521db769-5cc0-4650-825b-60d2bd65ba8e", "name": "network-vif-plugged", "status": "completed", "tag": "ab31841b-8c84-4191-8224-14d23e6435ca"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:49.528889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:49.528889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:26:49.545544 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-bd57fa62-23e8-473b-a733-4b728fe616ab req-aec1ea79-6eaa-439d-9e26-6de6b10039be service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:49.545999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-bd57fa62-23e8-473b-a733-4b728fe616ab req-aec1ea79-6eaa-439d-9e26-6de6b10039be service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:49.562920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-bd57fa62-23e8-473b-a733-4b728fe616ab req-aec1ea79-6eaa-439d-9e26-6de6b10039be service nova] Creating event network-vif-plugged:ab31841b-8c84-4191-8224-14d23e6435ca for instance 521db769-5cc0-4650-825b-60d2bd65ba8e on hv-cinder-78956 Aug 04 16:26:49.570772 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-bd57fa62-23e8-473b-a733-4b728fe616ab req-aec1ea79-6eaa-439d-9e26-6de6b10039be service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047761 Aug 04 16:26:49.571799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 255/518] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:49.639084 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:49.639918 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:49.649080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:49.649593 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:49.651070 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:49.651070 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:49.821858 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:49.838238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4e6bbd77-5da1-4293-90e6-935abde08d07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.196402 Aug 04 16:26:49.839116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 264/519] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:49 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:49.928854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:49.930130 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:49.939748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:49.940589 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:49.941600 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:49.942295 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.072359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:50.074265 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:50.088767 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.089300 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.090200 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.090831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.105478 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:50.115857 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bd6a5493-432b-4ad8-bfe1-64c0d621b27c tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.192065 Aug 04 16:26:50.125691 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 256/520] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:49 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:50.272966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:50.284111 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ef0c23f4-cb12-454a-8c29-6128cb73eff5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.216679 Aug 04 16:26:50.284736 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 265/521] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:50 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:50.347647 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:50.348298 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:50.355545 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.356032 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.356810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.357259 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.502948 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:50.525664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:50.527599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:50.529713 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cdfeb7df-fe60-4952-b3ec-d4fc8ccb64b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.186649 Aug 04 16:26:50.540868 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 257/522] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:50 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:50.561839 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:50.562749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:50.569410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.569850 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.570671 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.571103 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.599856 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:26:50.709215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-de1deddc-1463-4214-92fc-848ee67f6cb9 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 204 len: 0 microversion: 2.1 time: 0.150646 Aug 04 16:26:50.713033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 266/523] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:26:50 2021] DELETE /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:26:50.718922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:50.719539 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:50.727847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.728385 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.729424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.729927 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.857117 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:50.858763 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:50.865981 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.866599 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.867487 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:50.868665 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:50.886408 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:50.896459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-dee9d804-0b5a-459b-95df-ccd9c9efef04 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1514 microversion: 2.1 time: 0.181379 Aug 04 16:26:50.907664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 258/524] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:50 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:51.020763 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:51.030912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-31c330ff-cb50-4e1c-8cec-f83eb1dfdafb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.178913 Aug 04 16:26:51.031666 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 267/525] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:50 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:51.134711 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:51.135481 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:51.141558 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.141996 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:51.142787 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.143205 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:51.291631 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:51.302250 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c4cda4b3-bca1-4954-9c62-f1ea9512a80a tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1313 microversion: 2.1 time: 0.171509 Aug 04 16:26:51.303903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:51.305970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:51.314726 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 259/526] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:51 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:51.337849 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.338478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:51.339366 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.339877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:51.504594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:51.513983 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-65e998d5-12d1-4941-9093-c59b0dd71d77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.216610 Aug 04 16:26:51.514927 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 268/527] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:51 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:51.548619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:51.549929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:51.563190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.566992 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:51.568365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.568802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:51.739123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:51.752487 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:51.755938 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:51.757863 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-44652f95-0aa0-4022-a4b0-41178552f58d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.213325 Aug 04 16:26:51.758975 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 260/528] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:51 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:51.914409 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:51.915021 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:51.925385 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.925983 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:51.926908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:51.927525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.048846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:52.049456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:52.058021 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.058424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.059259 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.059697 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.070523 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:52.079475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e5ae8ed2-1637-4934-8007-104f68e93249 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1514 microversion: 2.1 time: 0.168708 Aug 04 16:26:52.080267 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 269/529] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:51 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:52.238323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:52.247151 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-44da1191-8b75-4578-836b-0387a6c03107 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.202101 Aug 04 16:26:52.248012 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 261/530] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:52 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:52.321319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:52.322100 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:52.336671 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.337118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.337910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.338404 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.514413 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:52.523388 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0698508e-7634-41ca-9506-b4c33aac305d tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1497 microversion: 2.1 time: 0.206289 Aug 04 16:26:52.526333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 270/531] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:52 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:52.537856 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:52.538771 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:52.558201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.559005 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.559617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.560238 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.737278 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:52.751487 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a0345aa0-1d86-4701-a1d9-5003afe16b47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1723 microversion: 2.1 time: 0.221413 Aug 04 16:26:52.753125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 262/532] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:52 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:52.790072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:52.791394 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:52.801675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.802792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.803819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:52.804253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:52.967865 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:52.976916 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:52.979361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:52.980660 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7c67a6e6-ce35-4693-a464-dd8f9003e017 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.197500 Aug 04 16:26:52.981295 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 271/533] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:52 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:53.097003 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:53.097534 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:53.104704 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.105146 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.105932 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.106379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.267368 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:53.268771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:53.277516 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:53.287688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.290480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.293652 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.295804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.321764 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1ab50820-66ed-4219-aea0-9e788184e88b tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1514 microversion: 2.1 time: 0.227303 Aug 04 16:26:53.330426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 263/534] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:53 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:53.391863 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:53.392367 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:53.418876 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.419690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.420870 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.422116 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.498323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:26:53.579964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:53.591547 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8708ab88-488d-4d73-80b0-6e7aec8b923f tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.330304 Aug 04 16:26:53.602642 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 272/535] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:53 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:53.657627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7794c77e-a1ce-43f3-af42-697f7477b2f9 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "DELETE /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 204 len: 0 microversion: 2.1 time: 0.274213 Aug 04 16:26:53.658370 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 264/536] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:26:53 2021] DELETE /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:26:53.670814 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:53.671841 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:53.679114 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.680035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.681092 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.681787 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.769931 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:53.772063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:53.782350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.783127 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.785475 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:53.787116 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:53.847778 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:53.856059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d8eb885c-f1d9-4bcb-b335-c74b729a03c2 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1503 microversion: 2.1 time: 0.191527 Aug 04 16:26:53.857272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 273/537] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:53 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:54.005384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:54.007280 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:54.022264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.022705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.023478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.023901 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.105742 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:54.121278 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e05fd784-80fc-4c37-a644-64264ae1c1da tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1700 microversion: 2.1 time: 0.355886 Aug 04 16:26:54.122289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 265/538] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:53 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1700 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:54.146101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-55c6cd02-a4e8-475f-8a4c-350af5ae6db8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:54.163862 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55c6cd02-a4e8-475f-8a4c-350af5ae6db8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.164930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55c6cd02-a4e8-475f-8a4c-350af5ae6db8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.198479 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-55c6cd02-a4e8-475f-8a4c-350af5ae6db8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Going to try to start instance {{(pid=107558) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 04 16:26:54.237990 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:54.249362 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:54.251052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:54.252203 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d90e84f1-fdf6-4f82-b8cb-06bb62ddfb39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.251087 Aug 04 16:26:54.259870 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 274/539] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:54 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:54.265699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-03cb7884-2a2a-4905-9a79-dc852d635a1b req-94275dbd-460d-4684-b643-5fe3a0f0a1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac01ba44-a812-49b3-b86e-9c48dda7d321", "name": "network-vif-deleted", "tag": "2f98095a-4190-47cd-bc6f-386032999d1c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:54.267370 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:54.267370 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:54.284208 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-03cb7884-2a2a-4905-9a79-dc852d635a1b req-94275dbd-460d-4684-b643-5fe3a0f0a1bb service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.284642 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-03cb7884-2a2a-4905-9a79-dc852d635a1b req-94275dbd-460d-4684-b643-5fe3a0f0a1bb service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.295963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-55c6cd02-a4e8-475f-8a4c-350af5ae6db8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 202 len: 0 microversion: 2.1 time: 0.154396 Aug 04 16:26:54.299418 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 266/540] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:26:54 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:26:54.310374 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-03cb7884-2a2a-4905-9a79-dc852d635a1b req-94275dbd-460d-4684-b643-5fe3a0f0a1bb service nova] Creating event network-vif-deleted:2f98095a-4190-47cd-bc6f-386032999d1c for instance ac01ba44-a812-49b3-b86e-9c48dda7d321 on hv-cinder-78956 Aug 04 16:26:54.319022 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-03cb7884-2a2a-4905-9a79-dc852d635a1b req-94275dbd-460d-4684-b643-5fe3a0f0a1bb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057781 Aug 04 16:26:54.319918 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 275/541] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:54.335631 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:54.336350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:54.345684 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:54.346741 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:54.357005 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.358544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.359866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.360440 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.364468 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.365403 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.365741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.366378 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.405928 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.408558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.409895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lazy-loading 'fault' on Instance uuid ac01ba44-a812-49b3-b86e-9c48dda7d321 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:26:54.484291 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:54.494269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cccbb78b-e4d5-4415-8f83-0e7260983666 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 200 len: 1308 microversion: 2.1 time: 0.153879 Aug 04 16:26:54.505803 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 276/542] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:54 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:54.612747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:54.614076 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:54.627173 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:54.631792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.632499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.634298 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.635476 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.640533 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bb0505c3-46d4-4b02-a473-b531048b1ba3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1709 microversion: 2.1 time: 0.335147 Aug 04 16:26:54.641809 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 267/543] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:54 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1709 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:54.851630 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:54.863321 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-52c7d615-be36-4772-bb0d-a020d02f53af tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.258370 Aug 04 16:26:54.864824 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 277/544] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:54 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:54.873932 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:54.874739 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:54.884871 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.889744 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:54.893021 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:54.895778 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.158851 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:55.170562 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2972beab-1fae-48f6-81b7-d55870408566 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1503 microversion: 2.1 time: 0.300098 Aug 04 16:26:55.188018 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 268/545] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:54 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:55.270772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:55.271388 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:55.277564 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.278032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.278828 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.279260 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.433927 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:55.446161 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:55.449219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:55.451123 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8a43bbc5-3051-421a-b90f-380bf9a74f80 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.184002 Aug 04 16:26:55.452601 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 278/546] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:55 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:55.512712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:55.513632 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ac01ba44-a812-49b3-b86e-9c48dda7d321] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:55.519949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.520570 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.521482 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.522130 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.537762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] HTTP exception thrown: Instance ac01ba44-a812-49b3-b86e-9c48dda7d321 could not be found. Aug 04 16:26:55.538509 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Returning 404 to user: Instance ac01ba44-a812-49b3-b86e-9c48dda7d321 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:26:55.539456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3f590f45-fe22-4f8b-8294-a513971ce877 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321" status: 404 len: 111 microversion: 2.1 time: 0.030676 Aug 04 16:26:55.540398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 269/547] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:55 2021] GET /compute/v2.1/servers/ac01ba44-a812-49b3-b86e-9c48dda7d321 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:26:55.659944 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:55.661862 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:55.669063 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.670348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.671788 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.672645 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.881310 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:55.881818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:55.883048 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:55.891683 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.894409 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cc3331e0-0b95-4d23-8b2e-f45dc4c56c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1709 microversion: 2.1 time: 0.238045 Aug 04 16:26:55.895225 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:55.896428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 279/548] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:55 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1709 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:55.896650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:55.898799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.197678 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:56.198478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:56.210937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.210937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.210937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.210937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.370406 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:56.382006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0c350f34-2937-46e9-b8b6-354e85f4e253 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.504177 Aug 04 16:26:56.395117 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 270/549] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:55 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:56.415815 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39928789024c475ca0ffa42106b2f3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5415912273de496e963a7c07ee381732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:56.425742 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d473070f-fa4d-4ba8-a6a1-177ea54a4898 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 200 len: 1503 microversion: 2.1 time: 0.233904 Aug 04 16:26:56.435471 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 280/550] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:56 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:56.472913 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:56.472913 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:56.483679 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.484121 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.485246 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.485680 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.708590 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-5a858e23-c6a1-420c-9ac7-429fe3be9eb2 req-ea372b01-c821-4eaf-a0d6-1ba08803b104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521db769-5cc0-4650-825b-60d2bd65ba8e", "name": "network-vif-deleted", "tag": "ab31841b-8c84-4191-8224-14d23e6435ca"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:26:56.723738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:26:56.723738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:26:56.738055 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-5a858e23-c6a1-420c-9ac7-429fe3be9eb2 req-ea372b01-c821-4eaf-a0d6-1ba08803b104 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.743354 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-5a858e23-c6a1-420c-9ac7-429fe3be9eb2 req-ea372b01-c821-4eaf-a0d6-1ba08803b104 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.746816 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:56.759764 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-5a858e23-c6a1-420c-9ac7-429fe3be9eb2 req-ea372b01-c821-4eaf-a0d6-1ba08803b104 service nova] Creating event network-vif-deleted:ab31841b-8c84-4191-8224-14d23e6435ca for instance 521db769-5cc0-4650-825b-60d2bd65ba8e on hv-cinder-78956 Aug 04 16:26:56.760953 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:56.765258 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-5a858e23-c6a1-420c-9ac7-429fe3be9eb2 req-ea372b01-c821-4eaf-a0d6-1ba08803b104 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063939 Aug 04 16:26:56.767907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:56.769118 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-856bab09-3e71-4d00-a1f9-7096e2efb8d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1740 microversion: 2.20 time: 0.301963 Aug 04 16:26:56.774652 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 271/551] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:56 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:56.781195 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 281/552] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:26:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:26:56.782867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:56.783365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:56.791273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.791711 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.792486 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.792915 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.827646 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:26:56.925251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:56.926567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:56.937851 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.938706 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.939800 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.946796 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.950703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-396cbea6-d818-4088-a88a-3e151491da64 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "DELETE /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 204 len: 0 microversion: 2.1 time: 0.174675 Aug 04 16:26:56.951950 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 272/553] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:26:56 2021] DELETE /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:26:56.962608 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:56.963580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:56.970192 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.970912 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:56.971840 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:56.972399 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:57.108376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:57.117718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-839b0064-ff3b-4ab0-8db9-b6fc9ed5d764 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1713 microversion: 2.1 time: 0.207796 Aug 04 16:26:57.118749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 282/554] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:56 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1713 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:57.121664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:57.130757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f15a6985-8a68-4463-8e48-61e9a4e4e6b7 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1513 microversion: 2.1 time: 0.173719 Aug 04 16:26:57.131513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 273/555] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:56 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:57.413446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:57.414048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:57.420593 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:57.421040 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:57.421808 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:57.422268 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:57.443163 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:57.443826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] [instance: 521db769-5cc0-4650-825b-60d2bd65ba8e] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:57.450207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:57.450658 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:57.451433 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:57.451867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:57.466361 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] HTTP exception thrown: Instance 521db769-5cc0-4650-825b-60d2bd65ba8e could not be found. Aug 04 16:26:57.466938 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] Returning 404 to user: Instance 521db769-5cc0-4650-825b-60d2bd65ba8e could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:26:57.467804 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1ef59f54-aabf-4ffd-8cdf-4bc0a3e3b2d8 tempest-VolumesActionsTest-1958328863 tempest-VolumesActionsTest-1958328863-project] 10.222.0.77 "GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e" status: 404 len: 111 microversion: 2.1 time: 0.028402 Aug 04 16:26:57.468357 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 274/556] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:57 2021] GET /compute/v2.1/servers/521db769-5cc0-4650-825b-60d2bd65ba8e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:26:57.548033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:57.556781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9ca05595-83fd-44dd-a4fb-db1cc261c309 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.147325 Aug 04 16:26:57.557367 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 283/557] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:57 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:57.787564 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:57.788188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:57.794426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:57.794889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:57.795651 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:57.796080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:57.962774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:57.971699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:57.973235 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:57.974779 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d8138827-5b6b-40ac-bb15-6d59eb9ce42b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1722 microversion: 2.20 time: 0.191495 Aug 04 16:26:57.975567 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 275/558] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:57 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:58.161547 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:58.162837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:58.173675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:58.174663 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:58.176286 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:58.177304 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:58.329570 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:58.339246 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-47076aa3-9037-4466-8390-43593c49a1e5 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1513 microversion: 2.1 time: 0.185004 Aug 04 16:26:58.339734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 284/559] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:58 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:26:58.575239 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:58.576518 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:58.587665 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:58.588115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:58.588939 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:58.589440 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:58.737739 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:58.747711 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-172ddbd1-0114-49f1-b9d1-dd1ce545ee5b tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.176355 Aug 04 16:26:58.748496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 276/560] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:58 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:58.995101 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:58.995705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:59.002779 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:59.003220 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:59.004006 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:59.004463 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:59.156431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:59.168160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:59.169662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:59.170887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0af8e08a-53d6-49f5-9bda-6338438b423c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1722 microversion: 2.20 time: 0.179817 Aug 04 16:26:59.171488 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 285/561] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:26:58 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:26:59.356356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:59.356941 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:59.366188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:59.366630 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:59.367425 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:59.367852 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:59.516264 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:59.524465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-509e955c-c73f-4ff2-b552-099f9ba54e2a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1513 microversion: 2.1 time: 0.171873 Aug 04 16:26:59.525038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 277/562] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:59 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:26:59.765493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:26:59.766160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:26:59.773059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:59.773498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:59.774316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:26:59.774745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:26:59.914446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:26:59.923176 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-43ef2888-4e63-4b08-9d28-94c53b64e6bc tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.161359 Aug 04 16:26:59.923824 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 286/563] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:26:59 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:00.189692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:00.190323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:00.197094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:00.197530 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:00.198341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:00.198766 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:00.361909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:00.370965 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:00.372466 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:00.373625 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-29a75475-40f0-4a29-a293-5f4ee788dc98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1722 microversion: 2.20 time: 0.187763 Aug 04 16:27:00.374212 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 278/564] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:00 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:00.542151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:00.542804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:00.551211 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:00.553869 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:00.554739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:00.555171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:00.692624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:00.702644 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-689f7f75-3958-4ede-9358-329e3c13f408 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1513 microversion: 2.1 time: 0.164975 Aug 04 16:27:00.703332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 287/565] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:00 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:00.941748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:00.942563 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:00.950065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:00.950510 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:00.951305 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:00.951734 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:01.087276 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:01.095994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4a07e609-063a-4032-9ff5-f0a5c57ef808 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.157969 Aug 04 16:27:01.096581 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 279/566] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:00 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:01.391949 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:01.392550 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:01.399284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:01.399727 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:01.400674 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:01.401105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:01.535689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:01.546110 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:01.547635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:01.549304 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-bed02f93-19d0-4947-9beb-3b32eb9a58d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1722 microversion: 2.20 time: 0.160884 Aug 04 16:27:01.550052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 288/567] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:01 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:01.723836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:01.724656 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:01.731514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:01.731979 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:01.732774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:01.733209 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:01.869439 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:01.870605 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-54790fd0-bf23-407b-8fa9-e927ffc49801 req-71d791bc-ad62-4a21-ac3f-ab2b1579efbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e525871-8d1f-4462-9cb5-7e3aeb9c3977", "name": "network-vif-unplugged", "status": "completed", "tag": "0da0ab28-3f37-48ae-94a1-42c44e08a854"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:01.872414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:01.872414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:27:01.878543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-68737c10-daaf-4170-a86f-7f4a0ce54b1f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1513 microversion: 2.1 time: 0.160291 Aug 04 16:27:01.880138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 280/568] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:01 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:01.880318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-54790fd0-bf23-407b-8fa9-e927ffc49801 req-71d791bc-ad62-4a21-ac3f-ab2b1579efbc service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:01.880741 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-54790fd0-bf23-407b-8fa9-e927ffc49801 req-71d791bc-ad62-4a21-ac3f-ab2b1579efbc service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:01.894976 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-54790fd0-bf23-407b-8fa9-e927ffc49801 req-71d791bc-ad62-4a21-ac3f-ab2b1579efbc service nova] Creating event network-vif-unplugged:0da0ab28-3f37-48ae-94a1-42c44e08a854 for instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 on hv-cinder-78956 Aug 04 16:27:01.906825 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-54790fd0-bf23-407b-8fa9-e927ffc49801 req-71d791bc-ad62-4a21-ac3f-ab2b1579efbc service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040071 Aug 04 16:27:01.907809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 289/569] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:27:02.113156 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:02.113834 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:02.121034 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.121561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.122467 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.122949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.348365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:02.356936 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-afbe2029-5d4b-4e03-9859-82524f4f09ef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.247788 Aug 04 16:27:02.357874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 281/570] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:02 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:27:02.568500 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:02.569823 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:02.577415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.578479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.579426 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.580116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.690514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-569af4f4-7766-4d18-b0c4-58c70305b41d req-4615ab0f-8827-434e-bed2-24024e555e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633aa183-b18b-4a00-b5c5-544b98236747", "name": "network-vif-deleted", "tag": "47499106-0a08-49c1-893b-db6e05e577ca"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:02.695464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:02.695464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:27:02.729042 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-569af4f4-7766-4d18-b0c4-58c70305b41d req-4615ab0f-8827-434e-bed2-24024e555e51 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.729717 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-569af4f4-7766-4d18-b0c4-58c70305b41d req-4615ab0f-8827-434e-bed2-24024e555e51 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.754163 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-569af4f4-7766-4d18-b0c4-58c70305b41d req-4615ab0f-8827-434e-bed2-24024e555e51 service nova] Creating event network-vif-deleted:47499106-0a08-49c1-893b-db6e05e577ca for instance 633aa183-b18b-4a00-b5c5-544b98236747 on hv-cinder-78956 Aug 04 16:27:02.765792 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-569af4f4-7766-4d18-b0c4-58c70305b41d req-4615ab0f-8827-434e-bed2-24024e555e51 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079119 Aug 04 16:27:02.769451 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 282/571] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:27:02.774583 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:02.793376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:02.797830 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:02.800702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2350424e-706a-413c-b78b-3f67c24a409c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1725 microversion: 2.20 time: 0.236850 Aug 04 16:27:02.801240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 290/572] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:02 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:02.821973 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e459229f-b749-4eec-a01d-3c093197b6b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6ba52f4-ab7f-4c5b-a261-62e2055e8447"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:02.823187 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e459229f-b749-4eec-a01d-3c093197b6b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:02.838849 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e459229f-b749-4eec-a01d-3c093197b6b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.840033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e459229f-b749-4eec-a01d-3c093197b6b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.841730 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e459229f-b749-4eec-a01d-3c093197b6b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.842930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e459229f-b749-4eec-a01d-3c093197b6b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.901438 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:02.902537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:02.913073 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.925537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:02.929074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:02.930525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:03.068465 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:03.097393 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c6ed0402-102f-4a77-a89b-548c688e19e1 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 200 len: 1302 microversion: 2.1 time: 0.197170 Aug 04 16:27:03.108475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 291/573] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:02 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:27:03.362627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e459229f-b749-4eec-a01d-3c093197b6b3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.545343 Aug 04 16:27:03.363627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 283/574] 10.222.0.77 () {62 vars in 1364 bytes} [Wed Aug 4 16:27:02 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-volume_attachments => generated 188 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:27:03.375283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:03.375915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:03.386874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:03.387291 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:03.388088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:03.391042 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:03.491450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-77a3172f-796f-4d18-9ce9-a3228252f0bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:03.492402 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-77a3172f-796f-4d18-9ce9-a3228252f0bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:03.505657 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-77a3172f-796f-4d18-9ce9-a3228252f0bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:03.506750 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-77a3172f-796f-4d18-9ce9-a3228252f0bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:03.508625 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-77a3172f-796f-4d18-9ce9-a3228252f0bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:03.509396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-77a3172f-796f-4d18-9ce9-a3228252f0bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:03.599441 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:03.614315 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4170fc38-b0b3-4fc9-8102-df87b17cf400 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.240353 Aug 04 16:27:03.616676 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 292/575] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:03 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:03.657325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-77a3172f-796f-4d18-9ce9-a3228252f0bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action" status: 202 len: 0 microversion: 2.20 time: 0.173461 Aug 04 16:27:03.658212 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 284/576] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:27:03 2021] POST /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:27:03.667842 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:03.673855 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:03.699939 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:03.700549 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:03.701559 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:03.702175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:03.888986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:03.899025 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:03.900772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:03.902904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4bfb4645-b719-477c-9689-d9590e1a2a19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1751 microversion: 2.20 time: 0.239177 Aug 04 16:27:03.903645 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 293/577] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:03 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:04.117216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:04.118118 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 633aa183-b18b-4a00-b5c5-544b98236747] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:04.124529 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.124975 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.125974 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.126855 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.152341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] HTTP exception thrown: Instance 633aa183-b18b-4a00-b5c5-544b98236747 could not be found. Aug 04 16:27:04.153328 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Returning 404 to user: Instance 633aa183-b18b-4a00-b5c5-544b98236747 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:27:04.154431 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4b8fe37d-92cf-4f0c-ad91-74a66bca51ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747" status: 404 len: 111 microversion: 2.1 time: 0.041970 Aug 04 16:27:04.155590 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 285/578] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:04 2021] GET /compute/v2.1/servers/633aa183-b18b-4a00-b5c5-544b98236747 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:27:04.165417 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:04.166078 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:04.172935 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.173723 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.174780 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.175743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.230897 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:27:04.379813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ca5db4d0-2ce2-4858-8ca0-1318f7b82d86 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 204 len: 0 microversion: 2.1 time: 0.219565 Aug 04 16:27:04.381465 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 294/579] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:27:04 2021] DELETE /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:27:04.393757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:04.394706 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:04.435442 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.437483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.438378 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.438828 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.590502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:04.606104 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-19dcd97d-5162-4a36-8417-63cfd7818483 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1515 microversion: 2.1 time: 0.216149 Aug 04 16:27:04.606104 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 286/580] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:04 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:04.639767 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:04.641414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:04.648132 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.649202 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.650370 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.651202 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.848006 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:04.859699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ee695d07-6a04-4027-9585-2a0d397152de tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.225003 Aug 04 16:27:04.860787 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 295/581] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:04 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:27:04.928530 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:04.929477 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:04.942676 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.943432 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:04.944332 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:04.944831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:05.127892 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:05.152707 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:05.154460 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:05.155664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7b6609a6-e0d7-4595-b503-b0911c85960c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1753 microversion: 2.20 time: 0.232443 Aug 04 16:27:05.156233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 287/582] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:04 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:05.622399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:05.623405 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:05.630661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:05.631318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:05.632225 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:05.632789 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:05.892720 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:05.894413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:05.927671 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:05.936473 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:05.940767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:05.941516 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:05.948507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:05.969463 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2148627c-446d-4b91-b6b1-c83a725d7ef6 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1515 microversion: 2.1 time: 0.351048 Aug 04 16:27:05.973515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 296/583] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:05 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:06.149930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:06.160756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cb44c42b-1aa8-4f7c-aaad-3130dd4005a2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.285558 Aug 04 16:27:06.161860 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 288/584] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:05 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:06.227002 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:06.227631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:06.237894 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:06.238656 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:06.239952 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:06.240678 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:06.412024 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:06.422666 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:06.424733 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:06.426109 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c5facdd9-ce2a-454b-a5b9-236ec665b056 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.204297 Aug 04 16:27:06.436743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 297/585] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:06 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:27:06.994049 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:06.994599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:07.001853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:07.002662 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:07.003826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:07.004464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:07.178946 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:07.180289 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:07.189708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:07.190254 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:07.191105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:07.191562 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:07.399314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:07.414588 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2f764581-803a-4b15-a339-b34647d06e83 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.239559 Aug 04 16:27:07.415651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 298/586] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:07 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:07.462296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:07.463690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:07.481170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:07.493246 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-42660086-075d-445b-9669-44cf7ab68fc8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1515 microversion: 2.1 time: 0.505198 Aug 04 16:27:07.496833 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 289/587] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:06 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1515 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:07.499296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:07.499961 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:07.500967 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:07.501608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:07.681464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:07.710440 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:07.731302 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:07.733357 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-37335417-2493-4a49-bd85-c9706a3902c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.279535 Aug 04 16:27:07.751428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 299/588] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:07 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:07.875354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-2969e7c3-3c11-4322-8f89-146c9876caa3 req-c170820c-8bbd-4f66-860b-15d887e659c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab28e453-d982-46f7-b51d-19d0a91ccfea", "name": "network-vif-deleted", "tag": "a3e775d0-e69d-4c40-9188-fbe388517260"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:07.877031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:07.877031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:27:07.888953 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-2969e7c3-3c11-4322-8f89-146c9876caa3 req-c170820c-8bbd-4f66-860b-15d887e659c3 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:07.889725 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-2969e7c3-3c11-4322-8f89-146c9876caa3 req-c170820c-8bbd-4f66-860b-15d887e659c3 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:07.916081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-2969e7c3-3c11-4322-8f89-146c9876caa3 req-c170820c-8bbd-4f66-860b-15d887e659c3 service nova] Creating event network-vif-deleted:a3e775d0-e69d-4c40-9188-fbe388517260 for instance ab28e453-d982-46f7-b51d-19d0a91ccfea on hv-cinder-78956 Aug 04 16:27:07.925001 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-2969e7c3-3c11-4322-8f89-146c9876caa3 req-c170820c-8bbd-4f66-860b-15d887e659c3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053280 Aug 04 16:27:07.934597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 290/589] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:27:08.438169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:08.438903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:08.445754 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:08.446241 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:08.447066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:08.447838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:08.521001 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:08.521936 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:08.535052 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:08.538526 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:08.548416 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:08.554491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:08.593155 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:08.593927 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:08.594867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lazy-loading 'fault' on Instance uuid ab28e453-d982-46f7-b51d-19d0a91ccfea {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:27:08.615014 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:08.638225 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fd6f60d4-6310-4a9c-a1cc-dabff7dca1ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.204230 Aug 04 16:27:08.650520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:08.651377 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 300/590] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:08 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:08.661407 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ff44759e-5b27-4227-a8dd-9c83897a91fd tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 200 len: 1308 microversion: 2.1 time: 0.145952 Aug 04 16:27:08.662450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 291/591] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:08 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:08.766389 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:08.767551 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:08.780657 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:08.781115 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:08.783201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:08.783680 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:08.983967 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:08.993911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:08.995673 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:08.996700 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-93ea55cf-a8d1-458a-8632-4564afcfd54f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.237580 Aug 04 16:27:08.997752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 301/592] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:08 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:09.658074 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:09.659088 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:09.669483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:09.679969 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:09.682566 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:09.683399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: ab28e453-d982-46f7-b51d-19d0a91ccfea] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:09.686936 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:09.687757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:09.690796 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:09.691555 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:09.693305 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:09.694090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:09.734389 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] HTTP exception thrown: Instance ab28e453-d982-46f7-b51d-19d0a91ccfea could not be found. Aug 04 16:27:09.735288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Returning 404 to user: Instance ab28e453-d982-46f7-b51d-19d0a91ccfea could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:27:09.736470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d6b925ae-a48b-46ec-ac8a-8a59c4253f2d tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea" status: 404 len: 111 microversion: 2.1 time: 0.061945 Aug 04 16:27:09.737701 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 302/593] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:09 2021] GET /compute/v2.1/servers/ab28e453-d982-46f7-b51d-19d0a91ccfea => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:27:09.915640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:09.932686 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bcd27645-e082-4d0d-9061-6e2deb925666 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.277741 Aug 04 16:27:09.944543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 292/594] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:09 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:10.029185 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:10.030352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:10.038105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:10.038924 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:10.039818 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:10.040403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:10.304680 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:10.345001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:10.349930 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:10.352610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-16eee39a-5fd4-48d2-87bd-d9a3eb53127d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.327762 Aug 04 16:27:10.353591 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 303/595] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:10 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:10.954734 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:10.956838 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:10.986294 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:10.987249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:10.989344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:10.991931 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:11.061302 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:11.062954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:11.074616 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:11.075440 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:11.076498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:11.077249 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:11.110097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:27:11.292341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:11.301147 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6e9cd5d7-4b44-4816-8745-7ac4b3b97d4f tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "DELETE /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 204 len: 0 microversion: 2.1 time: 0.249138 Aug 04 16:27:11.304541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 304/596] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:27:11 2021] DELETE /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:27:11.311221 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a4be27ed-5314-4ac4-a257-705402bc0932 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.361350 Aug 04 16:27:11.333438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 293/597] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:10 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:11.340123 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:11.341968 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:11.357196 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:11.357196 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:11.357196 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:11.357196 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:11.376671 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:11.380037 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:11.403721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:11.404531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:11.405920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:11.406980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:11.760473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:11.768536 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:11.779489 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-81a409f0-a802-4360-967f-516219366a1a tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.449554 Aug 04 16:27:11.781283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 305/598] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:11 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:11.796353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:11.799259 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:11.801151 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9046c0e2-c9b1-4a2d-917b-44408bf952c2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.430812 Aug 04 16:27:11.818481 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 294/599] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:11 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:12.351188 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:12.351957 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:12.366607 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:12.367387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:12.368878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:12.369479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:12.632001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:12.640761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-39c23880-f310-489c-a903-81469e2d9bb6 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.312883 Aug 04 16:27:12.641554 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 306/600] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:12 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:12.801781 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:12.802698 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:12.819454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:12.819772 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:12.822080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:12.822080 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:12.828511 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:12.829611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:12.863104 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:12.863550 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:12.864403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:12.864863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:13.020663 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:13.035799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cf7a244b-6369-4f11-9c2f-7a2d361aa69c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.237893 Aug 04 16:27:13.036558 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 295/601] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:12 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:13.075339 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:13.088769 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:13.090507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:13.091718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-954842ec-18d9-4cfb-acc6-2643762f1d40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.268570 Aug 04 16:27:13.092287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 307/602] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:12 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:13.660392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:13.661773 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:13.682973 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:13.684141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:13.685698 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:13.686485 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:13.911924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:13.924192 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7f464429-7cd8-4bfc-8c54-d60faf2a8bb4 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.268497 Aug 04 16:27:13.925678 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 296/603] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:13 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:14.053586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:14.054975 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:14.068018 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:14.073759 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:14.074718 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:14.075221 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:14.112467 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:14.113854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:14.121627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:14.122547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:14.123815 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:14.124519 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:14.253729 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:14.268503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-687ebef7-d27d-4b47-bc92-dae25e5cae51 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.219176 Aug 04 16:27:14.282690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 308/604] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:14 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:14.393202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:14.406855 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:14.408436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:14.412137 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-aee5e786-2e99-446b-a4d6-c5be9c262f87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.301358 Aug 04 16:27:14.413207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 297/605] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:14 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:14.945094 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:14.945606 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:14.953470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:14.953876 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:14.954715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:14.955134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:15.144159 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:15.155357 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-88522dda-3e7c-467d-9298-99a075f7fcb0 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.212894 Aug 04 16:27:15.166424 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 309/606] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:14 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:15.292345 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:15.294152 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:15.302825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:15.304004 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:15.305037 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:15.305827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:15.442410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:15.443473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:15.464054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:15.467928 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:15.472135 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:15.475798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:15.536319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:15.546993 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f33ddccc-0473-47e3-9cbc-c121edd0cd6c tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.259662 Aug 04 16:27:15.548145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 298/607] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:15 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:15.725348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:15.741244 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:15.749987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:15.749987 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-751f7516-db5d-4bba-a197-d9af0824c734 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.314350 Aug 04 16:27:15.762831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 310/608] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:15 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:16.178611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:16.178611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:16.179985 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:16.180428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:16.181217 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:16.181639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:16.368095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:16.382277 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e1195a64-95c6-4d78-9872-e80740240712 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.213102 Aug 04 16:27:16.383280 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 299/609] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:16 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:16.573350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:16.574706 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:16.587726 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:16.588508 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:16.590177 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:16.590914 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:16.776443 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:16.777500 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:16.783735 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:16.784157 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:16.784968 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:16.785449 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:16.841613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:16.856440 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-11dccd5e-ac87-4e8b-9773-884720bf9972 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.290462 Aug 04 16:27:16.857823 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 311/610] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:16 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:27:17.007328 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:17.016397 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:17.017911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:17.019165 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3a911587-7f79-4a1e-a9d4-a05f9c5bf418 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.252439 Aug 04 16:27:17.022799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 300/611] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:16 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:17.401109 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:17.401109 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:17.415552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:17.416002 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:17.416880 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:17.417350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:17.581750 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:17.591259 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-42b4ab10-fa19-4511-9496-220eb7b26c98 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.195124 Aug 04 16:27:17.602527 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 312/612] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:17 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:17.888213 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:17.888213 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:17.903483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:17.904278 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:17.905374 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:17.906060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:18.055240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:18.055950 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:18.072631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:18.073201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:18.079002 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:18.079565 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:18.106094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:18.118861 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a7ae24a8-380b-4233-b14c-6d517e737a68 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.241123 Aug 04 16:27:18.120281 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 301/613] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:17 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:18.267952 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:18.283073 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:18.284989 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:18.286284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1ab5d438-e383-4aed-a9d2-5fe65e63ddcc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.251219 Aug 04 16:27:18.297518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 313/614] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:18 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:18.608770 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:18.609884 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:18.617769 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:18.618710 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:18.619832 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:18.620486 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:18.799537 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:18.811814 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8e27e9c0-cd3b-409c-8b20-0a740f30fa50 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.206704 Aug 04 16:27:18.825345 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 302/615] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:18 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:19.146606 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:19.148079 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:19.157724 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:19.158580 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:19.159610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:19.160360 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:19.309458 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:19.310305 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:19.318459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:19.319554 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:19.320800 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:19.321489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:19.443913 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:19.452371 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-046f4ffa-8930-4100-839a-0ec4b9a5b7d2 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.309642 Aug 04 16:27:19.455318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 314/616] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:19 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:19.591090 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:19.600984 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:19.602538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:19.605028 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1f567d47-52fc-4f8b-8824-010879300c3a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.303620 Aug 04 16:27:19.606164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 303/617] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:19 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:19.833676 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:19.835578 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:19.842174 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:19.843498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:19.844636 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:19.845638 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:20.028683 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:20.039717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fe2a6936-df6e-4624-bbe8-9cf54b8c4bcb tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.210642 Aug 04 16:27:20.040316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 315/618] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:19 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:20.485235 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:20.485864 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:20.493196 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:20.493642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:20.494488 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:20.494920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:20.632687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:20.635312 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:20.637385 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:20.644189 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-89ed6e98-523e-458b-ab6d-40f1a92817d3 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.162907 Aug 04 16:27:20.644781 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 304/619] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:20 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:20.646899 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:20.647487 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:20.648358 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:20.648961 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:20.793590 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:20.805208 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:20.807331 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:20.809099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c548dbf0-ccb4-4d2a-abec-0e89e629da88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.178213 Aug 04 16:27:20.820921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 316/620] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:20 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:21.061366 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:21.062316 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:21.071577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:21.072193 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:21.073016 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:21.073520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:21.219870 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:21.230220 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-02be21fc-69d8-42ec-8109-31e48b64e7f2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.173392 Aug 04 16:27:21.230825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 305/621] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:21 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:21.665120 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:21.666377 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:21.674939 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:21.675723 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:21.677080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:21.677817 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:21.829151 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:21.829760 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:21.831007 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:21.837361 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:21.838115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:21.839108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:21.839702 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:21.841010 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-20c7f901-4de3-40c9-92ea-71a441b049de tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.181962 Aug 04 16:27:21.860301 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 317/622] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:21 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:22.027962 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:22.038438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:22.039987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:22.041148 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-95c43998-17ad-43b9-a446-acc9e98c51b1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.216176 Aug 04 16:27:22.041731 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 306/623] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:21 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:27:22.250520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:22.251129 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:22.258681 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:22.259125 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:22.259901 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:22.260319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:22.396433 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:22.405685 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-93c64c98-a08f-4407-ad2a-41afb3eaf678 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.160794 Aug 04 16:27:22.406300 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 318/624] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:22 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:22.860391 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:22.861767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:22.868491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:22.869183 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:22.869886 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:22.870413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:23.023369 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:23.032699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c43968b1-bf84-4b88-b85e-75c94a985731 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.175898 Aug 04 16:27:23.033502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 307/625] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:22 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:23.060275 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:23.060878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:23.067108 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:23.067598 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:23.068366 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:23.068791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:23.222098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:23.236189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:23.237755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:23.239319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-bb22664f-4227-4f12-bd59-3fc8cd82b988 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.182667 Aug 04 16:27:23.239904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 319/626] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:23 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:27:23.423778 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:23.424735 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:23.432867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:23.433762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:23.434885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:23.435534 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:23.677344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:23.693452 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-366211f7-2faf-4984-8a8d-568dd63f9135 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1565 microversion: 2.1 time: 0.273485 Aug 04 16:27:23.694380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 308/627] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:23 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1565 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:24.062979 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:24.063596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:24.071792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.072244 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:24.073052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.073484 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:24.222565 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:24.232125 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d3d479ea-b26f-460f-9e96-83cd843e23b8 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.172763 Aug 04 16:27:24.233907 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 320/628] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:24 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:24.262109 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:24.263270 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:24.273272 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.274093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:24.275131 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.275695 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:24.470777 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:24.483318 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:24.485577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:24.486987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bea220a8-196f-438b-aafa-edb762775f99 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.231358 Aug 04 16:27:24.498446 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 309/629] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:24 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:24.712794 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:24.713415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:24.721383 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.722537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:24.724062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.724776 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:24.875006 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:24.888280 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e24a10d7-1ca9-429d-bc73-9a11146dcb29 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1545 microversion: 2.1 time: 0.175801 Aug 04 16:27:24.888918 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 321/630] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:24 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1545 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:24.907206 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:24.907712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:24.915193 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.915860 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:24.917082 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:24.917544 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.027866 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] HTTP exception thrown: Cannot 'detach_volume' instance 64b045ab-defa-4f38-8178-9d493b95c21c while it is in vm_state rescued Aug 04 16:27:25.028469 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Returning 409 to user: Cannot 'detach_volume' instance 64b045ab-defa-4f38-8178-9d493b95c21c while it is in vm_state rescued {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:27:25.029647 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c2336dab-b5b7-430d-88e9-78033008385c tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "DELETE /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments/eb3afabe-9cb8-44ba-b958-9b25f35f2127" status: 409 len: 152 microversion: 2.1 time: 0.126866 Aug 04 16:27:25.030474 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 310/631] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:27:24 2021] DELETE /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments/eb3afabe-9cb8-44ba-b958-9b25f35f2127 => generated 152 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:27:25.039575 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-faf382a5-4496-4015-a145-236bd8e97367 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:25.040131 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-faf382a5-4496-4015-a145-236bd8e97367 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:25.046348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-faf382a5-4496-4015-a145-236bd8e97367 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.046791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-faf382a5-4496-4015-a145-236bd8e97367 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.047772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-faf382a5-4496-4015-a145-236bd8e97367 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.048375 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-faf382a5-4496-4015-a145-236bd8e97367 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.138556 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-faf382a5-4496-4015-a145-236bd8e97367 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action" status: 202 len: 0 microversion: 2.1 time: 0.101417 Aug 04 16:27:25.142343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 322/632] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:27:25 2021] POST /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:27:25.150226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:25.151200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:25.158737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.159560 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.161084 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.161883 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.252329 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:25.253341 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:25.260171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.260900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.266708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.267474 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.454627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:25.464891 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-220afeb7-e015-497a-8ee3-70458e3587da tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.216846 Aug 04 16:27:25.465792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 323/633] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:25 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:25.506287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:25.506902 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:25.517528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.518043 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.518904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:25.519339 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:25.637894 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:25.648186 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a36195c8-1600-4b79-b49e-84ea13d540ed tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1553 microversion: 2.1 time: 0.500804 Aug 04 16:27:25.649850 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 311/634] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:25 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1553 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:25.684695 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:25.694675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:25.696407 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:25.698091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-eb88a971-4104-4cb6-9691-dfbcff3cf39c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.195853 Aug 04 16:27:25.698829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 324/635] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:25 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:26.487055 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:26.487563 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:26.494570 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:26.495316 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:26.496619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:26.497335 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:26.671028 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:26.681387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:26.683008 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:26.684396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5c7ab82d-db4d-4e76-b625-858885e9cb56 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1515 microversion: 2.1 time: 0.201155 Aug 04 16:27:26.690003 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:26.690804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:26.691900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:26.692861 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:26.695497 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 312/636] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:26 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:26.721702 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:26.722705 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:26.731810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:26.732635 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:26.734751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:26.735810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:26.845190 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:26.861918 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4d262930-a182-4e90-8ee1-2b9e68b659ca tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1553 microversion: 2.1 time: 0.185298 Aug 04 16:27:26.864428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 325/637] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:26 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:27.004889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:27.019486 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:27.023456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:27.026492 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b6b2d146-896a-4ad6-a0e1-7e9c50e04cc2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.311215 Aug 04 16:27:27.027380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 313/638] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:26 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:27.319043 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-85e25888-60dd-455e-bbab-959735ad8ff8 req-6a9ce5be-22cd-4dab-9b6e-31865cedeac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb69746-5594-47c6-abfb-beffa84fb2ca", "name": "network-vif-deleted", "tag": "b162335e-7c27-4531-a303-ef9867eb115e"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:27.320719 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:27.320719 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:27:27.330832 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-85e25888-60dd-455e-bbab-959735ad8ff8 req-6a9ce5be-22cd-4dab-9b6e-31865cedeac7 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:27.330832 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-85e25888-60dd-455e-bbab-959735ad8ff8 req-6a9ce5be-22cd-4dab-9b6e-31865cedeac7 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:27.353867 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-85e25888-60dd-455e-bbab-959735ad8ff8 req-6a9ce5be-22cd-4dab-9b6e-31865cedeac7 service nova] Creating event network-vif-deleted:b162335e-7c27-4531-a303-ef9867eb115e for instance 3cb69746-5594-47c6-abfb-beffa84fb2ca on hv-cinder-78956 Aug 04 16:27:27.360667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-85e25888-60dd-455e-bbab-959735ad8ff8 req-6a9ce5be-22cd-4dab-9b6e-31865cedeac7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045779 Aug 04 16:27:27.361931 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 326/639] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:27:27.702043 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:27.702669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:27.709318 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:27.709697 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:27.710492 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:27.710928 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:27.744245 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:27.744694 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:27.745141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lazy-loading 'fault' on Instance uuid 3cb69746-5594-47c6-abfb-beffa84fb2ca {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:27:27.794134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72fafb88f9f430ca1e561be656dda0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814ea84104dd4ee1b125cc8688bffd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:27.806893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a2eead0e-a275-4acc-8159-2265a4cead45 tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 200 len: 1308 microversion: 2.1 time: 0.108789 Aug 04 16:27:27.807463 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 314/640] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:27 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:27.882169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:27.882896 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:27.889743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:27.890211 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:27.891221 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:27.891633 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.042953 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:28.052574 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:28.053627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:28.063051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.063514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.064368 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.064842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.064960 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-22577a3e-fa16-4984-b06e-480723060bd8 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1553 microversion: 2.1 time: 0.178124 Aug 04 16:27:28.065966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 327/641] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:27 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:28.159207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-281050ad-817b-4a97-9f16-f8c618eee2e4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:28.160186 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-281050ad-817b-4a97-9f16-f8c618eee2e4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:28.167338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-281050ad-817b-4a97-9f16-f8c618eee2e4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.167792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-281050ad-817b-4a97-9f16-f8c618eee2e4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.168576 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-281050ad-817b-4a97-9f16-f8c618eee2e4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.169225 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-281050ad-817b-4a97-9f16-f8c618eee2e4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.209374 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:28.218251 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:28.219757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:28.220936 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-59a37890-1689-4cd7-9a2e-d1d7a157a200 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.174749 Aug 04 16:27:28.221504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 315/642] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:28 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:27:28.255979 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-281050ad-817b-4a97-9f16-f8c618eee2e4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/action" status: 202 len: 0 microversion: 2.1 time: 0.099886 Aug 04 16:27:28.260027 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 328/643] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:27:28 2021] POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:27:28.265347 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:28.267093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:28.273758 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.274392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.275308 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.275963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.470594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:28.481144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b3b711b7-ed71-46b9-acd0-4d601bac6f9a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1750 microversion: 2.1 time: 0.219448 Aug 04 16:27:28.481966 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 316/644] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:28 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:28.824361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:28.824960 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] [instance: 3cb69746-5594-47c6-abfb-beffa84fb2ca] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:28.831626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.832101 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.835751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:28.835751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:28.848826 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] HTTP exception thrown: Instance 3cb69746-5594-47c6-abfb-beffa84fb2ca could not be found. Aug 04 16:27:28.849459 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] Returning 404 to user: Instance 3cb69746-5594-47c6-abfb-beffa84fb2ca could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:27:28.850361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-76c2dea3-f4bf-45aa-9b8a-57b4e55644ea tempest-AttachVolumeNegativeTest-1739549815 tempest-AttachVolumeNegativeTest-1739549815-project] 10.222.0.77 "GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca" status: 404 len: 111 microversion: 2.1 time: 0.030319 Aug 04 16:27:28.850969 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 329/645] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:28 2021] GET /compute/v2.1/servers/3cb69746-5594-47c6-abfb-beffa84fb2ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:27:29.094131 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:29.095610 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:29.116771 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.117216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.118027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.118446 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.241973 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:29.243119 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:29.251182 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.251397 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.252053 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.252655 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.292653 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:29.301810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5ccee44d-613b-45ac-8f4a-6513c32c5b07 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1559 microversion: 2.1 time: 0.219662 Aug 04 16:27:29.302924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 317/646] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:29 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:29.392081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:29.392708 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:29.399300 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.399753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.400531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.400960 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.500156 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:29.517269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:29.518973 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lazy-loading 'services' on Instance uuid 64b045ab-defa-4f38-8178-9d493b95c21c {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:27:29.520538 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:29.523080 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-50d3eb82-6557-4066-a1d4-971963fdeddf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.287322 Aug 04 16:27:29.534457 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 330/647] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:29 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:27:29.551683 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:29.552973 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:29.562728 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.563426 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.565149 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:29.565842 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:29.634528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4f135175-ae17-467b-b159-9e55c4dfc497 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "DELETE /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments/eb3afabe-9cb8-44ba-b958-9b25f35f2127" status: 202 len: 0 microversion: 2.1 time: 0.245735 Aug 04 16:27:29.634528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 318/648] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:27:29 2021] DELETE /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c/os-volume_attachments/eb3afabe-9cb8-44ba-b958-9b25f35f2127 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:27:29.749755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:29.759970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-824d6ec8-20cf-447e-bf5c-ba118abf72ec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.223930 Aug 04 16:27:29.760660 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 331/649] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:29 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:30.557031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:30.557723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:30.564137 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:30.564518 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:30.565301 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:30.565730 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:30.707723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:30.717606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:30.719151 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:30.720334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5a8697a5-0e0b-494a-8206-f6abfd1c9dd2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.171269 Aug 04 16:27:30.721469 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 319/650] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:30 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:30.779267 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:30.780066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:30.786538 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:30.786993 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:30.787835 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:30.788276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:30.944610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:30.953162 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7cc3ecfb-f138-4771-b09a-b3e258c8304c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.178311 Aug 04 16:27:30.953910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 332/651] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:30 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:31.740410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:31.741427 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:31.749123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:31.749677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:31.751547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:31.751547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:31.916636 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:31.930106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:31.932137 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:31.933675 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-94938b7f-f202-4688-b5e4-5984766a40ca tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.198246 Aug 04 16:27:31.934571 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 320/652] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:31 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:31.977879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:31.980025 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:31.989701 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:31.990253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:31.991134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:31.991577 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:32.158568 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:32.167567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-456bd8cf-9c41-498f-b755-ce2fad1a16e1 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.194817 Aug 04 16:27:32.168460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 333/653] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:31 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:32.952737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:32.953446 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:32.960102 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:32.960567 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:32.961324 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:32.961779 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:33.101036 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:33.118422 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:33.120671 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:33.123276 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cb36ec96-dde6-4410-9faa-a9f43a40d370 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.174217 Aug 04 16:27:33.124435 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 321/654] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:32 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:33.190587 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:33.191635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:33.209322 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:33.209977 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:33.210914 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:33.211359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:33.354334 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:33.365645 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-45329f52-791d-4501-b3dd-08c92519c2c2 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.180222 Aug 04 16:27:33.366244 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 334/655] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:33 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:34.143007 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:34.143776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:34.151323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.152141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.152994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.153424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.249328 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:34.250625 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:34.259482 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.260314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.261276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.261866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.300853 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:27:34.311767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:34.322381 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:34.328783 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:34.331241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6ba445bb-575c-4012-b5a0-46c2f1778a4f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.190991 Aug 04 16:27:34.332723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 322/656] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:34 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:34.382563 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:34.383190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:34.390266 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.390845 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.391724 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.392500 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.394714 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a76402b7-9c49-4067-8b43-5b79b9570d84 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "DELETE /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 204 len: 0 microversion: 2.1 time: 0.148833 Aug 04 16:27:34.395853 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 335/657] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:27:34 2021] DELETE /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:27:34.406348 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:34.408412 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:34.420340 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.420962 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.422622 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:34.423661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:34.574807 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:34.584674 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:34.587281 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-da0fb36b-9adb-432b-b54d-e1e89767f83d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.208662 Aug 04 16:27:34.587965 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 323/658] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:34 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:34.593362 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ec12aaaa-e1ae-434e-94fc-b73b96a3ebd5 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1506 microversion: 2.1 time: 0.192871 Aug 04 16:27:34.593892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 336/659] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:34 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:35.349126 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:35.349802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:35.356400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:35.356839 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:35.357615 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:35.358077 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:35.493802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:35.502594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:35.504169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:35.505362 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-87a03561-06d9-4bcc-9e97-0930c936a808 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.160293 Aug 04 16:27:35.506377 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 324/660] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:35 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:35.604625 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:35.605264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:35.610776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:35.611520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:35.611923 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:35.612365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:35.613194 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:35.613822 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:35.618587 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:35.619040 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:35.619828 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:35.620410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:35.770801 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:35.783270 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:35.784950 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a7d45201-c9b5-451a-984e-922acc00f975 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1506 microversion: 2.1 time: 0.177683 Aug 04 16:27:35.786024 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 325/661] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:35 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:27:35.796834 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2d9bdcb1-89be-4b5e-88fc-425bef8fa48f tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.195859 Aug 04 16:27:35.806534 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 337/662] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:35 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:36.106313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-85d9df3a-2d5a-4fad-9641-bfa9c32a3969 req-46030d7a-3d4c-4692-b461-159e6c89c897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e525871-8d1f-4462-9cb5-7e3aeb9c3977", "name": "network-vif-plugged", "status": "completed", "tag": "0da0ab28-3f37-48ae-94a1-42c44e08a854"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:36.107919 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:36.107919 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:27:36.116034 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-85d9df3a-2d5a-4fad-9641-bfa9c32a3969 req-46030d7a-3d4c-4692-b461-159e6c89c897 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:36.116662 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-85d9df3a-2d5a-4fad-9641-bfa9c32a3969 req-46030d7a-3d4c-4692-b461-159e6c89c897 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:36.133424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-85d9df3a-2d5a-4fad-9641-bfa9c32a3969 req-46030d7a-3d4c-4692-b461-159e6c89c897 service nova] Creating event network-vif-plugged:0da0ab28-3f37-48ae-94a1-42c44e08a854 for instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 on hv-cinder-78956 Aug 04 16:27:36.138556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-85d9df3a-2d5a-4fad-9641-bfa9c32a3969 req-46030d7a-3d4c-4692-b461-159e6c89c897 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035879 Aug 04 16:27:36.139444 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 326/663] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:27:36.524094 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:36.524690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:36.531000 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:36.531453 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:36.532230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:36.532646 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:36.665340 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:36.674436 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:36.675972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:36.677214 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e51ad84a-5865-4547-81b1-9c374aac142f tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.157136 Aug 04 16:27:36.677715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 338/664] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:36 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:36.803114 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:36.803768 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:36.810459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:36.810935 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:36.811778 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:36.812180 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:36.814429 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:36.814985 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:36.822627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:36.823140 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:36.823941 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:36.824374 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:36.960951 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:36.967413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-089382ee-982e-4c3a-af0c-4a36ca632ad2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1506 microversion: 2.1 time: 0.168454 Aug 04 16:27:36.978617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 327/665] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:36 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:37.000821 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:37.009550 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a4463679-7eda-4de3-b906-09ae9d2c57b9 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.198937 Aug 04 16:27:37.010432 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 339/666] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:36 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:37.379605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:27:37.379835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:27:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:27:37.698054 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:37.698663 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:37.707188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:37.707754 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:37.708588 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:37.709483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:37.898495 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:37.908018 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:37.909632 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:37.910934 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1d943c3f-fe5e-49a4-b52a-0bfcbf9423bc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.218091 Aug 04 16:27:37.911725 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 328/667] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:37 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:27:37.986212 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:37.987150 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:37.994734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:37.995273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:37.996334 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:37.997178 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:38.032555 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:38.033507 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:38.041162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:38.041835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:38.042839 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:38.043398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:38.179360 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:38.190512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-35999284-c583-4226-82ec-9aceea538b10 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1506 microversion: 2.1 time: 0.208326 Aug 04 16:27:38.191134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 340/668] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:37 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:38.317910 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:38.330145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fb93bd3b-4a93-490b-bd69-c535dfc51a30 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.306473 Aug 04 16:27:38.331624 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 329/669] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:38 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:38.530951 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-2a340e85-3e9e-4785-8157-e2280969d70a req-31f01bb2-fdf9-43dc-bd93-6479ec78d784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbda95db-cedf-447f-8281-789c89cd882c", "name": "network-vif-deleted", "tag": "ad29e72d-4ed7-4bfa-82b0-e745f01f619a"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:38.535544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:38.535544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:27:38.562531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-2a340e85-3e9e-4785-8157-e2280969d70a req-31f01bb2-fdf9-43dc-bd93-6479ec78d784 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:38.563147 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-2a340e85-3e9e-4785-8157-e2280969d70a req-31f01bb2-fdf9-43dc-bd93-6479ec78d784 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:38.588346 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-2a340e85-3e9e-4785-8157-e2280969d70a req-31f01bb2-fdf9-43dc-bd93-6479ec78d784 service nova] Creating event network-vif-deleted:ad29e72d-4ed7-4bfa-82b0-e745f01f619a for instance bbda95db-cedf-447f-8281-789c89cd882c on hv-cinder-78956 Aug 04 16:27:38.594380 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-2a340e85-3e9e-4785-8157-e2280969d70a req-31f01bb2-fdf9-43dc-bd93-6479ec78d784 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068678 Aug 04 16:27:38.595011 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 341/670] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:27:38.928743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:38.929545 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:38.936016 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:38.936454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:38.937214 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:38.937637 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:39.082775 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:39.091877 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:39.093401 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:39.094644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-07847a9e-3348-43c8-b997-bbffe4bbcd4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1809 microversion: 2.20 time: 0.169693 Aug 04 16:27:39.095257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 330/671] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:38 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:39.212054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:39.213654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:39.221863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:39.222624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:39.223747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:39.224439 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:39.266992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:39.267745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:39.268237 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lazy-loading 'fault' on Instance uuid bbda95db-cedf-447f-8281-789c89cd882c {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:27:39.332072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:39.338928 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1c8cf47c-5e83-45cf-9a4e-e079c4488901 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 200 len: 1311 microversion: 2.1 time: 0.133825 Aug 04 16:27:39.339499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 342/672] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:39 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:39.351836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:39.352620 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:39.358736 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:39.359153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:39.359937 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:39.360422 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:39.497018 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:39.506143 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8ea955a7-40aa-466a-aefd-354cf01d74d3 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.158512 Aug 04 16:27:39.507445 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 331/673] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:39 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:40.113752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:40.114317 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:40.120349 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.120820 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.121595 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.122017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.281635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:40.291037 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:40.292535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:40.293694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-de3d542f-b5ad-435a-bb13-fe794b556a5c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1796 microversion: 2.20 time: 0.184190 Aug 04 16:27:40.294301 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 343/674] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:27:40 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1796 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:27:40.361698 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:40.362698 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: bbda95db-cedf-447f-8281-789c89cd882c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:40.372995 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.373620 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.374912 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.375619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.399715 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] HTTP exception thrown: Instance bbda95db-cedf-447f-8281-789c89cd882c could not be found. Aug 04 16:27:40.400656 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Returning 404 to user: Instance bbda95db-cedf-447f-8281-789c89cd882c could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:27:40.402169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-81afab1d-9956-430b-b4e7-2c99928307d2 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c" status: 404 len: 111 microversion: 2.1 time: 0.047517 Aug 04 16:27:40.406712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 332/675] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:40 2021] GET /compute/v2.1/servers/bbda95db-cedf-447f-8281-789c89cd882c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:27:40.414837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:40.415741 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:40.425431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.426615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.428035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.428445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.457371 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:27:40.529666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:40.531159 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:40.542548 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.543371 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.544640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.545332 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.547144 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0b4e2c7d-083d-4f5a-bc3e-480410f28742 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "DELETE /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 204 len: 0 microversion: 2.1 time: 0.138389 Aug 04 16:27:40.550029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 344/676] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:27:40 2021] DELETE /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:27:40.559316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:40.560175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:40.566560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.567124 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.568507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:40.568941 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:40.702483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:40.711313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fc5e165c-c5b0-40c7-a8eb-ee479c0398df tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.189255 Aug 04 16:27:40.711988 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 333/677] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:40 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:40.787034 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:40.796559 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d75bd896-be41-40a9-809e-c5b84e166649 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.242016 Aug 04 16:27:40.797153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 345/678] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:40 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:41.729557 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:41.730786 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:41.737055 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:41.737529 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:41.738562 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:41.739284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:41.814391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:41.814996 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:41.822456 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:41.822456 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:41.822841 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:41.823269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:41.891963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:41.916204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ba3d251e-62e5-495a-b0f8-9684266a9919 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.190343 Aug 04 16:27:41.926011 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 334/679] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:41 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:42.019510 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:42.027269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9d8d8cd1-9786-4655-9c77-29df0ab4e8b9 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.217203 Aug 04 16:27:42.027839 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 346/680] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:41 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:27:42.940621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:42.941214 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:42.947373 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:42.947821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:42.948597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:42.949027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:43.046857 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:43.047808 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:43.056167 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:43.056675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:43.057528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:43.058044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:43.105909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:43.119029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a328ef45-5c32-4852-b1eb-c06d94f1c9f8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.182064 Aug 04 16:27:43.119623 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 335/681] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:42 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:27:43.204447 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:43.216933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b48be34c-636a-4b5e-9056-0d921a53c514 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.175560 Aug 04 16:27:43.217676 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 347/682] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:43 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:44.137982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:44.138768 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:44.145284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:44.145720 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:44.146527 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:44.146977 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:44.237587 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:44.238581 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:44.245353 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:44.245829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:44.246708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:44.247060 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:44.284206 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:44.293142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c406b6b2-127b-4bd5-8915-fc9304eb2d2b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.159241 Aug 04 16:27:44.293754 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 336/683] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:44 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:44.429574 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:44.438688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3318a27b-7dd1-46de-913e-a665a5dd4eef tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.207059 Aug 04 16:27:44.439508 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 348/684] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:44 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:45.310674 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:45.311262 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:45.322279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:45.322859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:45.328283 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:45.328713 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:45.457609 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:45.458273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:45.464715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:45.465216 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:45.466027 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:45.466765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:45.471242 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:45.480344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6c50e5ed-a3c2-4f06-87f4-0dfd19bc964b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.173305 Aug 04 16:27:45.480924 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 337/685] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:45 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:45.602933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:45.611425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f1d784ad-a87c-4cbe-befa-9132c34e58d3 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.158053 Aug 04 16:27:45.612117 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 349/686] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:45 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:46.498068 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:46.498777 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:46.505112 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:46.505643 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:46.506453 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:46.506882 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:46.628525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:46.630377 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:46.635969 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:46.637702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:46.638352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:46.639421 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:46.640185 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:46.647798 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1fc3b9a3-8ee6-4ce2-a406-02b8274d5aa4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.150436 Aug 04 16:27:46.658362 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 338/687] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:46 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:46.767613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:46.778062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3eaa8dff-9951-44ff-9f2e-6f9d1ec02e8e tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.153196 Aug 04 16:27:46.778819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 350/688] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:46 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:47.664387 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:47.665298 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:47.672506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:47.672997 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:47.673693 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:47.674154 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:47.795783 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:47.796477 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:47.803037 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:47.803320 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:47.804312 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:47.804719 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:47.813367 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:47.824437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-502eb982-1607-4ed0-8e36-836b74b15a5d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.164214 Aug 04 16:27:47.825398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 339/689] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:47 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:47.929701 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:47.937168 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-af0f6c33-3cac-4efc-aa65-3b27da72d735 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.145327 Aug 04 16:27:47.937747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 351/690] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:47 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:48.842373 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:48.842960 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:48.849386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:48.849802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:48.850638 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:48.851037 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:48.954234 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:48.954859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:48.962111 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:48.962705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:48.963610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:48.964047 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:49.042629 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:49.052419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4150fae4-0e74-4557-8f8c-0076b2846b0b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.214031 Aug 04 16:27:49.052982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 340/691] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:48 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:49.101096 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab01db624484965967b062acee41252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed276298dcd40d9b792743496b57580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:49.110619 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-aee92e3d-e646-4dbd-bad5-657d59f012ab tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 200 len: 1519 microversion: 2.1 time: 0.159842 Aug 04 16:27:49.111155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 352/692] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:48 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:49.405493 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-b0213469-bec9-4d39-850e-79f343261a55 req-ad7ae3b5-3853-4fb9-96d7-ab831519a35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b045ab-defa-4f38-8178-9d493b95c21c", "name": "network-vif-deleted", "tag": "3c98fd1f-2d8e-4194-8ece-0d194fbe1a41"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:49.407188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:49.407188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:27:49.416008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-b0213469-bec9-4d39-850e-79f343261a55 req-ad7ae3b5-3853-4fb9-96d7-ab831519a35e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:49.416460 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-b0213469-bec9-4d39-850e-79f343261a55 req-ad7ae3b5-3853-4fb9-96d7-ab831519a35e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:49.428295 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-b0213469-bec9-4d39-850e-79f343261a55 req-ad7ae3b5-3853-4fb9-96d7-ab831519a35e service nova] Creating event network-vif-deleted:3c98fd1f-2d8e-4194-8ece-0d194fbe1a41 for instance 64b045ab-defa-4f38-8178-9d493b95c21c on hv-cinder-78956 Aug 04 16:27:49.433640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-b0213469-bec9-4d39-850e-79f343261a55 req-ad7ae3b5-3853-4fb9-96d7-ab831519a35e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031848 Aug 04 16:27:49.434720 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 341/693] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:27:49.873211 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-523353841", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:49.928431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] validate_networks() for None {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:27:50.073035 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:50.074037 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:50.081683 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:50.082967 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:50.084327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:50.084838 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:50.229610 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:50.238428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-45ed2824-8e4f-4bed-958a-df17d0e256b8 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1755 microversion: 2.1 time: 0.170653 Aug 04 16:27:50.239040 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 342/694] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:50 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:50.248697 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:50.249487 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] [instance: 64b045ab-defa-4f38-8178-9d493b95c21c] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:50.260705 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:50.261686 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:50.262634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:50.263173 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:50.278614 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] HTTP exception thrown: Instance 64b045ab-defa-4f38-8178-9d493b95c21c could not be found. Aug 04 16:27:50.279230 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] Returning 404 to user: Instance 64b045ab-defa-4f38-8178-9d493b95c21c could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:27:50.280108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-210b609f-03dd-42c5-8d5e-4d7341804672 tempest-ServerRescueNegativeTestJSON-663708318 tempest-ServerRescueNegativeTestJSON-663708318-project] 10.222.0.77 "GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c" status: 404 len: 111 microversion: 2.1 time: 0.035958 Aug 04 16:27:50.280697 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 343/695] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:50 2021] GET /compute/v2.1/servers/64b045ab-defa-4f38-8178-9d493b95c21c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:27:50.470785 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:27:50.471292 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:27:50.471660 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:27:50.472104 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:27:50.472519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:27:50.482664 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:50.483036 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:50.483847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:50.484278 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:50.500964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Getting quotas for project afe39d5803f44a5ab105c541e26c30f2. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:27:50.508143 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Getting quotas for user a3a1b4e0b6d04e99bbfd81aaa9def857 and project afe39d5803f44a5ab105c541e26c30f2. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:27:50.517164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:27:50.520158 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:27:50.564119 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9ce3f144-2086-4f2f-b6b4-1e13e2fca690 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694660 Aug 04 16:27:50.565029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 353/696] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:27:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:27:50.575358 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e765185b-fa03-4129-bf67-587943fd7801 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:50.576072 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e765185b-fa03-4129-bf67-587943fd7801 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:50.654502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e765185b-fa03-4129-bf67-587943fd7801 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:50.668073 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e765185b-fa03-4129-bf67-587943fd7801 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1214 microversion: 2.1 time: 0.096682 Aug 04 16:27:50.668893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 344/697] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:50 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:51.257629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:51.258585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:51.265274 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:51.266115 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:51.267150 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:51.267586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:51.411520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:51.419982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-67473a18-43b1-49d4-8a76-e1fe21ceb27d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1758 microversion: 2.1 time: 0.167034 Aug 04 16:27:51.420596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 354/698] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:51 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:51.687446 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:51.688220 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:51.695158 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:51.695642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:51.696599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:51.697026 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:51.777162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:51.785155 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0245ae3a-de5b-488c-a900-e6fac404ea16 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1266 microversion: 2.1 time: 0.101475 Aug 04 16:27:51.786030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 345/699] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:51 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:52.802802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:52.803745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:52.810376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:52.810907 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:52.811743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:52.812414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:52.899555 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:52.907475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ead72e54-851b-41b8-8dad-214f713f239a tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1266 microversion: 2.1 time: 0.108571 Aug 04 16:27:52.908412 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 355/700] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:52 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:53.931587 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:53.932199 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:53.938626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:53.939070 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:53.939867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:53.940324 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:54.038001 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:54.045596 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cdef7bc6-2341-4e48-bde9-254670cd40d2 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1274 microversion: 2.1 time: 0.117716 Aug 04 16:27:54.046210 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 346/701] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:53 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:55.063970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:55.064806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:55.079532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:55.080566 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:55.081490 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:55.081992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:55.158612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:55.166714 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5cf7e78b-415e-4420-a838-86f2967e88f0 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1272 microversion: 2.1 time: 0.106912 Aug 04 16:27:55.167317 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 356/702] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:55 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:56.089815 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:56.090446 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:56.097284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:56.098254 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:56.099036 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:56.099470 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:56.189301 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:56.191715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:56.207273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:56.212694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:56.214402 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:56.217615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:56.223463 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lazy-loading 'services' on Instance uuid ee88d756-5674-4fae-a650-a006454697e6 {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:27:56.342191 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1ad2cd45-3014-4398-858a-213e5db91e77 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/os-volume_attachments/edc01946-afa3-46a7-954b-19605177f7ad" status: 202 len: 0 microversion: 2.1 time: 0.257530 Aug 04 16:27:56.342992 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 347/703] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:27:56 2021] DELETE /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/os-volume_attachments/edc01946-afa3-46a7-954b-19605177f7ad => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:27:56.393343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:56.407230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ed5481c2-96dd-47e3-8421-778453752a30 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1314 microversion: 2.1 time: 0.226181 Aug 04 16:27:56.407798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 357/704] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:56 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:56.566982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-6e10750e-bf1e-472c-a1f1-0b52a1f41214 req-7d5db4a2-e307-4b94-a42e-041b19dc328e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e51ddc-3654-4874-8848-4c3d3fb7d886", "tag": "4f19351a-fe9d-4660-b653-0f08586b3231"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:27:56.568776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:27:56.568776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:27:56.585107 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-6e10750e-bf1e-472c-a1f1-0b52a1f41214 req-7d5db4a2-e307-4b94-a42e-041b19dc328e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:56.585483 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-6e10750e-bf1e-472c-a1f1-0b52a1f41214 req-7d5db4a2-e307-4b94-a42e-041b19dc328e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:56.603566 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-6e10750e-bf1e-472c-a1f1-0b52a1f41214 req-7d5db4a2-e307-4b94-a42e-041b19dc328e service nova] Creating event network-changed:4f19351a-fe9d-4660-b653-0f08586b3231 for instance a4e51ddc-3654-4874-8848-4c3d3fb7d886 on hv-cinder-78956 Aug 04 16:27:56.609295 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-6e10750e-bf1e-472c-a1f1-0b52a1f41214 req-7d5db4a2-e307-4b94-a42e-041b19dc328e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048261 Aug 04 16:27:56.610484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 348/705] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:27:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:27:57.429528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:57.430702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:57.441017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:57.441017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:57.442165 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:57.442611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:57.613738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:57.621054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2069cf09-9607-4c2a-8dbb-f28c37f5e3ae tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1314 microversion: 2.1 time: 0.198610 Aug 04 16:27:57.622201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 358/706] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:57 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:58.639396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:58.640105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:58.646600 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:58.647275 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:58.647863 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:58.648271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:58.777779 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:58.785371 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-76dcb03c-9b3b-45e4-883e-58625bb14dcd tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1314 microversion: 2.1 time: 0.149835 Aug 04 16:27:58.786047 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 349/707] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:58 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:27:59.805282 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:27:59.805922 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:27:59.813336 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:59.813867 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:59.814769 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:27:59.815252 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:27:59.953066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:27:59.961540 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-228af6c5-2d01-4d88-bcd2-794cd6fd9896 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1314 microversion: 2.1 time: 0.160811 Aug 04 16:27:59.962344 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 359/708] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:27:59 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:00.681071 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-6e047c02-2921-4d58-932f-1a8bcd9c5ab5 req-b3a7bf0a-8d3a-4ea6-937b-92652131ddfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e51ddc-3654-4874-8848-4c3d3fb7d886", "name": "network-vif-plugged", "status": "completed", "tag": "4f19351a-fe9d-4660-b653-0f08586b3231"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:00.682987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:00.682987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:28:00.690857 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-6e047c02-2921-4d58-932f-1a8bcd9c5ab5 req-b3a7bf0a-8d3a-4ea6-937b-92652131ddfe service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:00.691496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-6e047c02-2921-4d58-932f-1a8bcd9c5ab5 req-b3a7bf0a-8d3a-4ea6-937b-92652131ddfe service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:00.710399 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-6e047c02-2921-4d58-932f-1a8bcd9c5ab5 req-b3a7bf0a-8d3a-4ea6-937b-92652131ddfe service nova] Creating event network-vif-plugged:4f19351a-fe9d-4660-b653-0f08586b3231 for instance a4e51ddc-3654-4874-8848-4c3d3fb7d886 on hv-cinder-78956 Aug 04 16:28:00.716067 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-6e047c02-2921-4d58-932f-1a8bcd9c5ab5 req-b3a7bf0a-8d3a-4ea6-937b-92652131ddfe service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038989 Aug 04 16:28:00.717392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 350/709] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:28:00.978491 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:00.979207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:00.985330 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:00.985777 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:00.986575 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:00.987000 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:01.110375 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:01.118166 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7660aa88-3baa-450e-a330-cd6e07612ef3 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1314 microversion: 2.1 time: 0.143282 Aug 04 16:28:01.118855 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 360/710] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:00 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:02.136435 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:02.137274 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:02.144063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:02.144839 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:02.145839 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:02.146302 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:02.272249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:02.280240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3247061b-f148-47e9-b7eb-6ec0383af0c8 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1464 microversion: 2.1 time: 0.147822 Aug 04 16:28:02.280821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 351/711] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:02 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:02.318475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:02.319102 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:02.325408 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:02.325857 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:02.326687 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:02.327157 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:02.353025 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:28:02.446959 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7ea63876-ae4d-4c3d-849b-7961559c2773 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "DELETE /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 204 len: 0 microversion: 2.1 time: 0.131999 Aug 04 16:28:02.447623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 361/712] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:28:02 2021] DELETE /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:28:02.459741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:02.461212 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:02.467991 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:02.468421 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:02.469230 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:02.469661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:02.593050 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:02.601214 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a58655ea-fee2-4f4c-9912-d7fb56389501 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1470 microversion: 2.1 time: 0.147057 Aug 04 16:28:02.601803 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 352/713] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:02 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:03.620116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:03.620768 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:03.627287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:03.627732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:03.628516 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:03.629145 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:03.759836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:03.768092 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-66024815-658a-461c-b5c4-6fdb5f012634 tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1470 microversion: 2.1 time: 0.152200 Aug 04 16:28:03.768655 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 362/714] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:03 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:04.765826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-3697104e-c310-4abc-9132-eb5c02ec40fe req-7eaa170e-8226-45a9-84b3-6c13ee14b879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e51ddc-3654-4874-8848-4c3d3fb7d886", "name": "network-vif-deleted", "tag": "4f19351a-fe9d-4660-b653-0f08586b3231"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:04.767453 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:04.767453 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:28:04.775597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-3697104e-c310-4abc-9132-eb5c02ec40fe req-7eaa170e-8226-45a9-84b3-6c13ee14b879 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:04.776038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-3697104e-c310-4abc-9132-eb5c02ec40fe req-7eaa170e-8226-45a9-84b3-6c13ee14b879 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:04.786119 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:04.786942 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:04.789077 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-3697104e-c310-4abc-9132-eb5c02ec40fe req-7eaa170e-8226-45a9-84b3-6c13ee14b879 service nova] Creating event network-vif-deleted:4f19351a-fe9d-4660-b653-0f08586b3231 for instance a4e51ddc-3654-4874-8848-4c3d3fb7d886 on hv-cinder-78956 Aug 04 16:28:04.793755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:04.793973 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-3697104e-c310-4abc-9132-eb5c02ec40fe req-7eaa170e-8226-45a9-84b3-6c13ee14b879 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032240 Aug 04 16:28:04.794391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:04.794987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 353/715] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:28:04.795419 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:04.796097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:04.867704 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a1b4e0b6d04e99bbfd81aaa9def857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe39d5803f44a5ab105c541e26c30f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:04.875835 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-352fbd04-e2a1-412d-a2d1-7cb4544d84ec tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 200 len: 1299 microversion: 2.1 time: 0.094492 Aug 04 16:28:04.876424 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 363/716] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:04 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:28:05.893675 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:05.894479 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] [instance: a4e51ddc-3654-4874-8848-4c3d3fb7d886] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:05.901353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:05.901798 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:05.902719 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:05.903047 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:05.916582 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] HTTP exception thrown: Instance a4e51ddc-3654-4874-8848-4c3d3fb7d886 could not be found. Aug 04 16:28:05.917169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] Returning 404 to user: Instance a4e51ddc-3654-4874-8848-4c3d3fb7d886 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:28:05.918051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b1a3240b-6b25-419f-a3b5-8426cb6f42db tempest-VolumesNegativeTest-1891558327 tempest-VolumesNegativeTest-1891558327-project] 10.222.0.77 "GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886" status: 404 len: 111 microversion: 2.1 time: 0.028521 Aug 04 16:28:05.918594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 354/717] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:05 2021] GET /compute/v2.1/servers/a4e51ddc-3654-4874-8848-4c3d3fb7d886 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:28:13.526961 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4c8ecf27-c11c-4996-8e68-1b3a637dc33f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:13.533615 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4c8ecf27-c11c-4996-8e68-1b3a637dc33f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:13.534200 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4c8ecf27-c11c-4996-8e68-1b3a637dc33f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:13.598398 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4c8ecf27-c11c-4996-8e68-1b3a637dc33f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Going to try to stop instance {{(pid=107559) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 04 16:28:13.649721 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4c8ecf27-c11c-4996-8e68-1b3a637dc33f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 202 len: 0 microversion: 2.1 time: 0.126263 Aug 04 16:28:13.650528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 364/718] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:28:13 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:28:13.659406 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:13.660680 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:13.666693 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:13.667143 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:13.667994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:13.668427 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:13.800357 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:13.808226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8c0ac31c-1bd5-41f3-9529-e20204c3948b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.152769 Aug 04 16:28:13.808824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 355/719] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:13 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:14.827052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:14.827758 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:14.835414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:14.835840 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:14.836666 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:14.837082 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:14.971610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:14.980476 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-50eafba1-b8af-4090-8097-aa5bd73414bd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.157542 Aug 04 16:28:14.981072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 365/720] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:14 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:16.000194 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:16.001942 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:16.012914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:16.013690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:16.015095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:16.016145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:16.285170 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:16.293063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-757eb748-5bdb-4c11-a00d-85b47bdd54e2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.297316 Aug 04 16:28:16.293769 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 356/721] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:15 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:17.311316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:17.311977 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:17.318613 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:17.319030 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:17.320008 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:17.320609 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:17.472734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:17.482091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-05381fbe-03db-488f-a689-d6854ce2f138 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.174886 Aug 04 16:28:17.483269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 366/722] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:17 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:18.500663 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:18.501737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:18.508144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:18.508592 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:18.509627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:18.510265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:18.664237 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:18.672094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5bb41397-14ca-4d1e-876d-42e7ac70d39a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.175104 Aug 04 16:28:18.683051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 357/723] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:18 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:19.689491 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:19.690218 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:19.703485 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:19.704433 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:19.707457 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:19.708103 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:20.075370 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:20.089888 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-618cbe39-7156-4a95-ab31-3bf6e07b03a6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.404867 Aug 04 16:28:20.101597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 367/724] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:19 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:21.107913 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:21.109378 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:21.116390 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:21.117858 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:21.119568 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:21.121172 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:21.269600 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:21.277841 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5b17c976-50d2-4509-9213-5140cc19fd89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.173907 Aug 04 16:28:21.278584 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 358/725] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:21 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:22.302915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:22.304624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:22.318743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:22.319531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:22.320594 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:22.321226 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:22.498098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:22.506596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-35035cc4-5806-4908-b780-f49da49d37d5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.210776 Aug 04 16:28:22.511028 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 368/726] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:22 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:23.529085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:23.529704 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:23.541497 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:23.542333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:23.544999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:23.546800 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:23.941300 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:23.953212 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-27dc3394-be90-45d2-8620-543956789674 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.428073 Aug 04 16:28:23.953820 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 359/727] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:23 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:24.971057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:24.971621 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:24.979910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:24.980387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:24.981212 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:24.981666 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:25.229483 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:25.245826 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-174bdba0-c6b3-47fd-b978-472a9c85249e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.278517 Aug 04 16:28:25.247062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 369/728] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:24 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:26.273485 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:26.274745 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:26.285999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:26.291745 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:26.292915 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:26.293573 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:26.601139 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:26.615020 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c3c97d44-eed4-42a7-be5e-0b2269f6ee8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.353792 Aug 04 16:28:26.617338 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 360/729] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:26 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:27.635596 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:27.636368 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:27.652971 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:27.654634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:27.655784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:27.664451 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4a737d1d-0cae-44cb-8619-3e210a762e3d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Action: 'create', calling method: .version_select at 0x7f271846b430>, body: {"keypair": {"name": "tempest-TestShelveInstance-935437709"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:27.665408 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:27.693369 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-4a737d1d-0cae-44cb-8619-3e210a762e3d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Getting quotas for project 76829aee5bb64de2bb202e81a575e30d. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:28:27.698700 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-4a737d1d-0cae-44cb-8619-3e210a762e3d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Getting quotas for user 867b156b0c2741d1b60d95f9d9df2210 and project 76829aee5bb64de2bb202e81a575e30d. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:28:27.804388 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-4a737d1d-0cae-44cb-8619-3e210a762e3d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Getting quotas for project 76829aee5bb64de2bb202e81a575e30d. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:28:27.810812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-4a737d1d-0cae-44cb-8619-3e210a762e3d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Getting quotas for user 867b156b0c2741d1b60d95f9d9df2210 and project 76829aee5bb64de2bb202e81a575e30d. Resources: {'key_pairs'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:28:27.837724 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4a737d1d-0cae-44cb-8619-3e210a762e3d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.515749 Aug 04 16:28:27.838597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 370/730] 10.222.0.77 () {60 vars in 1158 bytes} [Wed Aug 4 16:28:27 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:27.890913 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:27.900935 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-92373e79-8aa7-4c12-9f37-f2ff28fa356b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.270429 Aug 04 16:28:27.901556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 361/731] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:27 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:28.926327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:28.928878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:28.945575 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:28.946410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:28.948837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:28.951597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:29.245906 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:29.260651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-10c210d8-ce90-4d29-b93b-332b45356f74 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1677 microversion: 2.1 time: 0.345881 Aug 04 16:28:29.262811 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 371/732] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:28 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1677 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:30.285544 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:30.287037 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:30.296713 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:30.297555 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:30.308217 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:30.308922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:30.489688 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:30.503564 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-38b3222a-d29c-4613-bbba-b56424d69a29 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1654 microversion: 2.1 time: 0.227314 Aug 04 16:28:30.504644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 362/733] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:30 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1654 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:30.528242 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-17d5fc9b-06f0-4026-80a7-bcd8a0bf6cba tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:30.538768 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-17d5fc9b-06f0-4026-80a7-bcd8a0bf6cba tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:30.539283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-17d5fc9b-06f0-4026-80a7-bcd8a0bf6cba tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:30.568392 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-17d5fc9b-06f0-4026-80a7-bcd8a0bf6cba tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Going to try to start instance {{(pid=107559) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 04 16:28:30.625249 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-17d5fc9b-06f0-4026-80a7-bcd8a0bf6cba tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action" status: 202 len: 0 microversion: 2.1 time: 0.101558 Aug 04 16:28:30.625858 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 372/734] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:28:30 2021] POST /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:28:30.634974 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:30.635851 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:30.642686 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:30.643390 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:30.644614 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:30.645340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:30.962164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:30.979700 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0dea15c2-ed47-4b42-8575-a43341b71b2d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1663 microversion: 2.1 time: 0.348405 Aug 04 16:28:30.980348 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 363/735] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:30 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1663 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:31.997229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:31.997907 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:32.004906 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:32.005352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:32.006189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:32.006626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:32.136016 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:32.143841 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8df3c483-c0d6-4d7a-95cd-3068b170876c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1663 microversion: 2.1 time: 0.150777 Aug 04 16:28:32.144421 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 373/736] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:31 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:32.413447 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3a2e4e02-dcc7-46af-8a9c-6bfbef46f1c4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:32.414014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3a2e4e02-dcc7-46af-8a9c-6bfbef46f1c4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:32.421434 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a2e4e02-dcc7-46af-8a9c-6bfbef46f1c4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:32.425173 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a2e4e02-dcc7-46af-8a9c-6bfbef46f1c4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:32.426179 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a2e4e02-dcc7-46af-8a9c-6bfbef46f1c4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:32.426615 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3a2e4e02-dcc7-46af-8a9c-6bfbef46f1c4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:32.460147 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3a2e4e02-dcc7-46af-8a9c-6bfbef46f1c4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-volume_attachments/e6ba52f4-ab7f-4c5b-a261-62e2055e8447" status: 200 len: 194 microversion: 2.20 time: 0.052132 Aug 04 16:28:32.461340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 364/737] 10.222.0.77 () {60 vars in 1454 bytes} [Wed Aug 4 16:28:32 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-volume_attachments/e6ba52f4-ab7f-4c5b-a261-62e2055e8447 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:28:32.541226 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:32.542041 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:32.551839 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:32.552581 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:32.553889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:32.554751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:32.650995 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lazy-loading 'services' on Instance uuid 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:28:32.737157 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-11f101a8-138d-46b1-82c5-5c54babe03bb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-volume_attachments/e6ba52f4-ab7f-4c5b-a261-62e2055e8447" status: 202 len: 0 microversion: 2.20 time: 0.201102 Aug 04 16:28:32.741393 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 374/738] 10.222.0.77 () {60 vars in 1457 bytes} [Wed Aug 4 16:28:32 2021] DELETE /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977/os-volume_attachments/e6ba52f4-ab7f-4c5b-a261-62e2055e8447 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:28:33.162602 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:33.163247 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:33.169897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:33.170180 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:33.170971 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:33.171396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:33.303769 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:33.326853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-57d047f8-2e61-4378-bc4b-1a0cade3e4d4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1667 microversion: 2.1 time: 0.158685 Aug 04 16:28:33.338054 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 365/739] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:33 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:28:33.900869 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:33.901438 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:33.908124 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:33.908583 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:33.909896 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:33.910384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:33.943431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:28:34.037030 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a9e993c1-885e-4f4e-bdeb-d26218839c27 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 204 len: 0 microversion: 2.20 time: 0.140051 Aug 04 16:28:34.038046 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 375/740] 10.222.0.77 () {60 vars in 1280 bytes} [Wed Aug 4 16:28:33 2021] DELETE /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:28:34.049082 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:34.051311 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:34.058778 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:34.059289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:34.060177 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:34.060647 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:34.234806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:34.246217 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:34.247704 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:34.248951 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-060e21e6-dbff-4f24-819a-4a75bf953b8c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.206422 Aug 04 16:28:34.249468 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 366/741] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:34 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:35.268547 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:35.270048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:35.275868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:35.276318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:35.277091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:35.277513 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:35.422189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:35.436375 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:35.439534 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:35.442086 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-18d1c52d-1a10-48cd-8f47-36210c29876d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.177116 Aug 04 16:28:35.443133 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 376/742] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:35 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:36.465389 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:36.466068 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:36.472703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:36.473227 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:36.474161 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:36.474589 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:36.734366 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:36.748614 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:36.752103 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:36.755326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5a44220c-6480-474c-89f6-e8078ba7d2f4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1724 microversion: 2.20 time: 0.293339 Aug 04 16:28:36.757393 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 367/743] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:36 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:37.182376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-5136bed6-a71a-4382-a278-b6d98636e99e req-75035ee8-670f-44e9-b979-1457a710f770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e525871-8d1f-4462-9cb5-7e3aeb9c3977", "name": "network-vif-deleted", "tag": "0da0ab28-3f37-48ae-94a1-42c44e08a854"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:37.184401 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:37.184401 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:28:37.195904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-5136bed6-a71a-4382-a278-b6d98636e99e req-75035ee8-670f-44e9-b979-1457a710f770 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:37.199469 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-5136bed6-a71a-4382-a278-b6d98636e99e req-75035ee8-670f-44e9-b979-1457a710f770 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:37.217036 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-5136bed6-a71a-4382-a278-b6d98636e99e req-75035ee8-670f-44e9-b979-1457a710f770 service nova] Creating event network-vif-deleted:0da0ab28-3f37-48ae-94a1-42c44e08a854 for instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 on hv-cinder-78956 Aug 04 16:28:37.223449 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-5136bed6-a71a-4382-a278-b6d98636e99e req-75035ee8-670f-44e9-b979-1457a710f770 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045355 Aug 04 16:28:37.225049 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 377/744] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:28:37.786300 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:37.787926 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:37.794775 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:37.795226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:37.796593 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:37.797179 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:37.854967 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:37.855418 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:37.856023 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lazy-loading 'fault' on Instance uuid 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:28:37.913386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:37.923026 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:37.924804 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:37.926051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-03f3004c-2af5-4e17-9e6c-d9a28afe177d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 200 len: 1371 microversion: 2.20 time: 0.144893 Aug 04 16:28:37.926621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 368/745] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:37 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:38.955656 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:38.956501 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:38.974688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:38.975503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:38.976736 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:38.977710 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:38.995931 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] HTTP exception thrown: Instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 could not be found. Aug 04 16:28:38.996996 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Returning 404 to user: Instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:28:38.998469 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4632ecde-4202-479f-a084-d1fdffd90c14 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 404 len: 111 microversion: 2.20 time: 0.047121 Aug 04 16:28:38.999479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 378/746] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:38 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:28:39.008145 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-eaac773e-d9ac-4333-bda2-f7a2a089013d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '.version_select at 0x7f2718219940>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:39.040570 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-eaac773e-d9ac-4333-bda2-f7a2a089013d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825984446" status: 204 len: 0 microversion: 2.20 time: 0.035872 Aug 04 16:28:39.046538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 369/747] 10.222.0.77 () {60 vars in 1262 bytes} [Wed Aug 4 16:28:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825984446 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 16:28:39.749319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-991765849"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:39.749848 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:39.755972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:39.756415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:39.757243 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:39.757684 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:39.846796 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-63fe7691-9cf2-422b-a4a8-3f55493316df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'create', calling method: .version_select at 0x7f2718208e50>, body: {"keypair": {"name": "tempest-keypair-885254945"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:39.869574 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-63fe7691-9cf2-422b-a4a8-3f55493316df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:28:39.873882 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-63fe7691-9cf2-422b-a4a8-3f55493316df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for user efcd395088e74895bd13523cbad21afc and project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:28:39.890835 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.network.security_group_api [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Removing security group e5a6013c-8210-4748-ba4c-aa2fab3cace6 from port 25c02836-f5d3-4db9-bfb6-3cfc493da78c Aug 04 16:28:40.179089 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-63fe7691-9cf2-422b-a4a8-3f55493316df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:28:40.182893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-63fe7691-9cf2-422b-a4a8-3f55493316df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for user efcd395088e74895bd13523cbad21afc and project e94f253973de4174807e633c0f67ea51. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:28:40.196622 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-63fe7691-9cf2-422b-a4a8-3f55493316df tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.354562 Aug 04 16:28:40.197238 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 370/748] 10.222.0.77 () {62 vars in 1199 bytes} [Wed Aug 4 16:28:39 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 356 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Aug 04 16:28:40.265284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b4462f33-e782-497d-bb42-da65c96d151d tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/action" status: 202 len: 0 microversion: 2.1 time: 0.519724 Aug 04 16:28:40.266379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 379/749] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:28:39 2021] POST /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:28:40.285136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-3604ad8f-6cb5-44d4-8868-404468bbf189 req-8f32fc42-05a3-42af-981c-1a27721d11ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc4cbe9-9ab3-4a0f-8e98-af6face4a038", "tag": "25c02836-f5d3-4db9-bfb6-3cfc493da78c"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:40.288601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:40.288601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:28:40.315405 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-3604ad8f-6cb5-44d4-8868-404468bbf189 req-8f32fc42-05a3-42af-981c-1a27721d11ec service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:40.316052 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-3604ad8f-6cb5-44d4-8868-404468bbf189 req-8f32fc42-05a3-42af-981c-1a27721d11ec service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:40.338639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-3604ad8f-6cb5-44d4-8868-404468bbf189 req-8f32fc42-05a3-42af-981c-1a27721d11ec service nova] Creating event network-changed:25c02836-f5d3-4db9-bfb6-3cfc493da78c for instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 on hv-cinder-78956 Aug 04 16:28:40.345151 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-3604ad8f-6cb5-44d4-8868-404468bbf189 req-8f32fc42-05a3-42af-981c-1a27721d11ec service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065804 Aug 04 16:28:40.346260 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 371/750] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:28:42.315534 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:42.317895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:42.331815 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:42.332369 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:42.333188 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:42.333705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:42.373297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-f5cb93c6-bf94-41c3-be56-db50e376095b req-499b1d59-a7e1-4b2a-8ee8-5d4345df1d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc4cbe9-9ab3-4a0f-8e98-af6face4a038", "tag": "25c02836-f5d3-4db9-bfb6-3cfc493da78c"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:42.374883 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:42.374883 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:28:42.383742 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-f5cb93c6-bf94-41c3-be56-db50e376095b req-499b1d59-a7e1-4b2a-8ee8-5d4345df1d73 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:42.384182 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-f5cb93c6-bf94-41c3-be56-db50e376095b req-499b1d59-a7e1-4b2a-8ee8-5d4345df1d73 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:42.405333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-f5cb93c6-bf94-41c3-be56-db50e376095b req-499b1d59-a7e1-4b2a-8ee8-5d4345df1d73 service nova] Creating event network-changed:25c02836-f5d3-4db9-bfb6-3cfc493da78c for instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 on hv-cinder-78956 Aug 04 16:28:42.414504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-f5cb93c6-bf94-41c3-be56-db50e376095b req-499b1d59-a7e1-4b2a-8ee8-5d4345df1d73 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045019 Aug 04 16:28:42.440248 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 372/751] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:28:42.485662 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lazy-loading 'services' on Instance uuid 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:28:42.591289 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6cac26e1-9557-44fe-8738-bb455b64667a tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments/ac9a9522-c983-4dd8-95ad-71eb99d28025" status: 202 len: 0 microversion: 2.1 time: 0.279632 Aug 04 16:28:42.592874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 380/752] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:28:42 2021] DELETE /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments/ac9a9522-c983-4dd8-95ad-71eb99d28025 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:28:42.602661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7fce2675-b168-4915-a83c-dd7eb46cdc4c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:42.604646 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7fce2675-b168-4915-a83c-dd7eb46cdc4c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:42.619539 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7fce2675-b168-4915-a83c-dd7eb46cdc4c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:42.620796 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7fce2675-b168-4915-a83c-dd7eb46cdc4c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:42.621828 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7fce2675-b168-4915-a83c-dd7eb46cdc4c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:42.622479 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7fce2675-b168-4915-a83c-dd7eb46cdc4c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:42.709085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7fce2675-b168-4915-a83c-dd7eb46cdc4c tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111792 Aug 04 16:28:42.723496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 373/753] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 4 16:28:42 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:28:42.925101 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2127858056", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3375530b-34ca-4462-9339-3ed10ebd346b"}], "security_groups": [{"name": "tempest-securitygroup--1910733430"}], "key_name": "tempest-keypair-885254945", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:43.048944 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] validate_networks() for [('3375530b-34ca-4462-9339-3ed10ebd346b', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:28:43.650792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:28:43.651349 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:28:43.651697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:28:43.652187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:28:43.652864 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:28:43.663195 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:43.663636 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:43.664643 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:43.665895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:43.688576 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for project e94f253973de4174807e633c0f67ea51. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:28:43.694528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Getting quotas for user efcd395088e74895bd13523cbad21afc and project e94f253973de4174807e633c0f67ea51. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:28:43.707758 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:28:43.712029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:28:43.731885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0b320133-2a63-4d48-a14b-06b426c2e3aa tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:43.735747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0b320133-2a63-4d48-a14b-06b426c2e3aa tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:43.739049 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0a3e30e-7a55-4740-a186-1b6a0cde96a2] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 16:28:43.755592 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0b320133-2a63-4d48-a14b-06b426c2e3aa tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:43.756036 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0b320133-2a63-4d48-a14b-06b426c2e3aa tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:43.756850 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0b320133-2a63-4d48-a14b-06b426c2e3aa tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:43.757324 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0b320133-2a63-4d48-a14b-06b426c2e3aa tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:43.769877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3ce4ef00-7e07-4d06-85ec-de07e26cd304 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.849882 Aug 04 16:28:43.776238 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 381/754] 10.222.0.77 () {62 vars in 1188 bytes} [Wed Aug 4 16:28:42 2021] POST /compute/v2.1/servers => generated 402 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:28:43.781314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cc40e6f5-cead-4e5a-841a-14128a9127fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:43.781935 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cc40e6f5-cead-4e5a-841a-14128a9127fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:43.808362 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0b320133-2a63-4d48-a14b-06b426c2e3aa tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083418 Aug 04 16:28:43.809096 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 374/755] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 4 16:28:43 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:28:43.828505 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:43.830138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:43.840563 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:43.841030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:43.841847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:43.842299 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:43.864460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cc40e6f5-cead-4e5a-841a-14128a9127fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:43.876719 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cc40e6f5-cead-4e5a-841a-14128a9127fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:43.879284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cc40e6f5-cead-4e5a-841a-14128a9127fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:43.883029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cc40e6f5-cead-4e5a-841a-14128a9127fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1281 microversion: 2.20 time: 0.105628 Aug 04 16:28:43.883618 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 382/756] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:43 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1281 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:43.994143 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] HTTP exception thrown: Instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 is not attached to volume ac9a9522-c983-4dd8-95ad-71eb99d28025 Aug 04 16:28:43.995122 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Returning 404 to user: Instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 is not attached to volume ac9a9522-c983-4dd8-95ad-71eb99d28025 {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:28:43.996689 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-beeeacda-03ab-437f-97ad-9ef9ac73e231 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments/ac9a9522-c983-4dd8-95ad-71eb99d28025" status: 404 len: 154 microversion: 2.1 time: 0.180091 Aug 04 16:28:43.997712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 375/757] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:28:43 2021] DELETE /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038/os-volume_attachments/ac9a9522-c983-4dd8-95ad-71eb99d28025 => generated 154 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:28:44.898733 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 16:28:44.902112 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:44.902722 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:44.911031 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:44.911637 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:44.912518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:44.913168 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:44.999199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:45.008908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:45.010443 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:45.011542 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8f49bcf2-93b1-47eb-9cbc-52158d1b55e5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1333 microversion: 2.20 time: 0.114377 Aug 04 16:28:45.012136 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 383/758] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:44 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:45.235206 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:45.236963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:45.258603 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0a3e30e-7a55-4740-a186-1b6a0cde96a2] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 53130. Aug 04 16:28:45.263196 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:45.263650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:45.264445 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:45.264874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:45.291619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:28:45.387974 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-40cefbbb-3e0b-4052-9f67-61e9db5c1eec tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 204 len: 0 microversion: 2.1 time: 0.156210 Aug 04 16:28:45.392597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 376/759] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:28:45 2021] DELETE /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:28:45.399656 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:45.400725 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:45.407740 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:45.408307 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:45.409202 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:45.410750 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:45.564493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:45.573467 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-50f8defa-9a73-4ab2-afae-207a4b47f044 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1553 microversion: 2.1 time: 0.179287 Aug 04 16:28:45.574520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 384/760] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:45 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:46.037888 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:46.038616 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:46.048868 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:46.050435 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:46.051849 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:46.054548 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:46.331441 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:46.344950 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:46.347753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:46.349461 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c72abf75-ae36-47a8-952f-431148407316 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1407 microversion: 2.20 time: 0.322726 Aug 04 16:28:46.350347 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 377/761] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:46 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:46.606671 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:46.607478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:46.625562 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 53156. Aug 04 16:28:46.627266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:46.627709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:46.629009 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:46.629645 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:46.739827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-d2057c27-cd14-4f39-ad11-873a3ed9ca09 req-5309966b-5a9f-4d66-a3da-a69de71f607e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dceabbf2-ecd4-497b-997a-1acbda49ddf9", "tag": "17e1d80b-51b6-4b09-b512-e218dc6eaeaa"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:46.742786 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:46.742786 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:28:46.763318 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-d2057c27-cd14-4f39-ad11-873a3ed9ca09 req-5309966b-5a9f-4d66-a3da-a69de71f607e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:46.763797 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-d2057c27-cd14-4f39-ad11-873a3ed9ca09 req-5309966b-5a9f-4d66-a3da-a69de71f607e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:46.777236 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-d2057c27-cd14-4f39-ad11-873a3ed9ca09 req-5309966b-5a9f-4d66-a3da-a69de71f607e service nova] Creating event network-changed:17e1d80b-51b6-4b09-b512-e218dc6eaeaa for instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 on hv-cinder-78956 Aug 04 16:28:46.783714 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-d2057c27-cd14-4f39-ad11-873a3ed9ca09 req-5309966b-5a9f-4d66-a3da-a69de71f607e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056876 Aug 04 16:28:46.785089 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 378/762] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:28:46.800459 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:46.809267 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c722b1c9-8fe8-4580-bf79-dbaadcf650a4 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1553 microversion: 2.1 time: 0.219835 Aug 04 16:28:46.809852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 385/763] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:46 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:47.371537 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:47.372260 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:47.380666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:47.381204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:47.382089 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:47.382721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:47.595142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:47.603905 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:47.605705 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:47.607074 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-40053bf0-447b-49d2-acd2-7331847a7564 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1407 microversion: 2.20 time: 0.240039 Aug 04 16:28:47.607681 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 379/764] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:47 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:47.827630 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:47.828409 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:47.838653 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:47.839131 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:47.839955 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:47.840387 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:48.003742 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:48.014030 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-95be1784-b30b-4084-ad2d-f8cfde154c5b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1553 microversion: 2.1 time: 0.190080 Aug 04 16:28:48.015479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 386/765] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:47 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:48.078285 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1863248512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-935437709", "security_groups": [{"name": "tempest-secgroup-smoke-1194969388"}], "networks": [{"uuid": "185b7905-00dc-4ba4-a3c5-437dece76adb"}], "block_device_mapping_v2": [{"uuid": "8dea6aea-b14d-4f94-b92c-ff8de06482da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:48.220604 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] validate_networks() for [('185b7905-00dc-4ba4-a3c5-437dece76adb', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:28:48.625153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:48.625752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:48.631847 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:48.632277 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:48.633054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:48.633470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:48.713552 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:28:48.714177 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:28:48.714572 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:28:48.714967 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:28:48.715652 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:28:48.725706 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:48.726185 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:48.726982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:48.727410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:48.747285 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Getting quotas for project 76829aee5bb64de2bb202e81a575e30d. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:28:48.752098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Getting quotas for user 867b156b0c2741d1b60d95f9d9df2210 and project 76829aee5bb64de2bb202e81a575e30d. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:28:48.782867 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:48.793147 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:48.794810 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:48.796373 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4f192059-e407-426c-b15a-0dba3c9f96fe tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1407 microversion: 2.20 time: 0.175014 Aug 04 16:28:48.797215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 387/766] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:48 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:48.806511 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-9579771c-3458-4268-96d7-74d4c2c3b5c8 req-cee87e57-f742-479a-810b-0b5e4bdbd4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc4cbe9-9ab3-4a0f-8e98-af6face4a038", "name": "network-vif-deleted", "tag": "25c02836-f5d3-4db9-bfb6-3cfc493da78c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:48.808383 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:48.808383 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:28:48.816045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-9579771c-3458-4268-96d7-74d4c2c3b5c8 req-cee87e57-f742-479a-810b-0b5e4bdbd4d6 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:48.816484 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-9579771c-3458-4268-96d7-74d4c2c3b5c8 req-cee87e57-f742-479a-810b-0b5e4bdbd4d6 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:48.836048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-9579771c-3458-4268-96d7-74d4c2c3b5c8 req-cee87e57-f742-479a-810b-0b5e4bdbd4d6 service nova] Creating event network-vif-deleted:25c02836-f5d3-4db9-bfb6-3cfc493da78c for instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 on hv-cinder-78956 Aug 04 16:28:48.840789 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:28:48.843041 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dea6aea-b14d-4f94-b92c-ff8de06482da',volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:28:48.846296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-9579771c-3458-4268-96d7-74d4c2c3b5c8 req-cee87e57-f742-479a-810b-0b5e4bdbd4d6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043246 Aug 04 16:28:48.858723 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 388/767] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:28:49.034435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:49.035541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:49.043120 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:49.043885 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:49.044962 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:49.045610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:49.066266 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6f169d03-e69f-4d9f-8c1c-c7c31feee39a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.991148 Aug 04 16:28:49.068485 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 380/768] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:28:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:28:49.088050 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8aa980dd-8546-4f4a-b2bd-5f196d9278f2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:49.089345 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8aa980dd-8546-4f4a-b2bd-5f196d9278f2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:49.099460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:49.100372 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:49.101125 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lazy-loading 'fault' on Instance uuid 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:28:49.175339 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc84bb769c84dda9cd539b89dbb9fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b483243f1443f891eee772089355e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:49.184941 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1fb3117a-69c3-4f81-a68c-a1629c583d4b tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 200 len: 1347 microversion: 2.1 time: 0.155119 Aug 04 16:28:49.185608 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8aa980dd-8546-4f4a-b2bd-5f196d9278f2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:49.195765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 389/769] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:49 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 1347 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:28:49.200522 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8aa980dd-8546-4f4a-b2bd-5f196d9278f2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1088 microversion: 2.1 time: 0.122279 Aug 04 16:28:49.201574 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 381/770] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:49 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1088 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:28:49.814852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:49.815486 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:49.821771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:49.822253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:49.823078 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:49.823511 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:49.956056 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:49.964298 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:49.965842 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:49.966966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-128ae0bb-85be-4bc4-9bc4-89a925234d97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1407 microversion: 2.20 time: 0.155951 Aug 04 16:28:49.967507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 390/771] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:49 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:28:50.203619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:50.205033 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] [instance: 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:50.217687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:50.218510 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:50.219928 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:50.220206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:50.220685 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:50.221470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:50.231493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:50.232645 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:50.233767 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:50.234560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:50.250139 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] HTTP exception thrown: Instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 could not be found. Aug 04 16:28:50.251407 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Returning 404 to user: Instance 0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:28:50.253730 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bef4bb09-24f1-449c-9c72-88c338f69f51 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038" status: 404 len: 111 microversion: 2.1 time: 0.053560 Aug 04 16:28:50.255824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 382/772] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:50 2021] GET /compute/v2.1/servers/0dc4cbe9-9ab3-4a0f-8e98-af6face4a038 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:28:50.273456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d9612d84-1b44-4dbd-9bb9-c5a27cd3db04 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] Calling method '.version_select at 0x7f27181ccc10>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:50.309552 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d9612d84-1b44-4dbd-9bb9-c5a27cd3db04 tempest-TestMinimumBasicScenario-94106886 tempest-TestMinimumBasicScenario-94106886-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-800586162" status: 202 len: 0 microversion: 2.1 time: 0.044609 Aug 04 16:28:50.311410 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:50.312391 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 383/773] 10.222.0.77 () {58 vars in 1269 bytes} [Wed Aug 4 16:28:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-800586162 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:28:50.330222 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ea00f4a7-bbad-4a51-9d15-297a3e58b5ec tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1194 microversion: 2.1 time: 0.114266 Aug 04 16:28:50.342240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 391/774] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:50 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:50.984665 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:50.985279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:50.992112 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:50.992566 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:50.993355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:50.993789 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:51.274082 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-aa0cb5a3-605b-4a33-a0d3-96ba4d38af8a req-74f9c557-082e-438e-9f21-f1790094119b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dceabbf2-ecd4-497b-997a-1acbda49ddf9", "name": "network-vif-plugged", "status": "completed", "tag": "17e1d80b-51b6-4b09-b512-e218dc6eaeaa"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:51.277218 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:51.277218 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:28:51.287732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-aa0cb5a3-605b-4a33-a0d3-96ba4d38af8a req-74f9c557-082e-438e-9f21-f1790094119b service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:51.288597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-aa0cb5a3-605b-4a33-a0d3-96ba4d38af8a req-74f9c557-082e-438e-9f21-f1790094119b service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:51.320287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-aa0cb5a3-605b-4a33-a0d3-96ba4d38af8a req-74f9c557-082e-438e-9f21-f1790094119b service nova] Creating event network-vif-plugged:17e1d80b-51b6-4b09-b512-e218dc6eaeaa for instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 on hv-cinder-78956 Aug 04 16:28:51.332227 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-aa0cb5a3-605b-4a33-a0d3-96ba4d38af8a req-74f9c557-082e-438e-9f21-f1790094119b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067303 Aug 04 16:28:51.334800 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 392/775] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:28:51.361263 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:51.363612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:51.377746 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:51.379980 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:51.381376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:51.382104 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:51.686634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:51.694763 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-22d42082-860d-4fa9-a39b-f2833e56bae1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.338776 Aug 04 16:28:51.695285 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 393/776] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:51 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:28:51.699481 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:51.717297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:51.719016 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:51.720400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e7490ceb-11cb-4771-bad7-250a92b92680 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1407 microversion: 2.20 time: 0.739610 Aug 04 16:28:51.721153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 384/777] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:50 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1407 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:28:52.316026 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-8f9e4b59-4ec8-4561-aaca-87e54eabbf33 req-a44b3ca8-af47-4c50-9e88-684860bbe876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cc5de9-b97f-4969-b926-672feb3d04e4", "tag": "e6adc942-2649-44f9-a5ef-fe285a7906d7"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:52.318772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:52.318772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:28:52.326876 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-8f9e4b59-4ec8-4561-aaca-87e54eabbf33 req-a44b3ca8-af47-4c50-9e88-684860bbe876 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:52.330496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-8f9e4b59-4ec8-4561-aaca-87e54eabbf33 req-a44b3ca8-af47-4c50-9e88-684860bbe876 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:52.348754 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-8f9e4b59-4ec8-4561-aaca-87e54eabbf33 req-a44b3ca8-af47-4c50-9e88-684860bbe876 service nova] Creating event network-changed:e6adc942-2649-44f9-a5ef-fe285a7906d7 for instance 30cc5de9-b97f-4969-b926-672feb3d04e4 on hv-cinder-78956 Aug 04 16:28:52.359261 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-8f9e4b59-4ec8-4561-aaca-87e54eabbf33 req-a44b3ca8-af47-4c50-9e88-684860bbe876 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047116 Aug 04 16:28:52.359904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 394/778] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:28:52.712712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:52.713524 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:52.725523 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:52.726026 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:52.726934 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:52.727365 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:52.743946 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:52.745224 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:52.758585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:52.760103 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:52.761996 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:52.762793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:52.948743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:52.961220 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-aef259bf-0b64-4281-bdc3-82fcd3496673 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.252028 Aug 04 16:28:52.962512 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 385/779] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:52 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:53.068825 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:53.077288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:53.080279 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:53.082057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a9db21dd-8328-4cb2-b416-ba14c74dddef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1598 microversion: 2.20 time: 0.346741 Aug 04 16:28:53.082646 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 395/780] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:28:52 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1598 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:28:53.100099 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c62fa835-e885-49cb-b965-250febed577e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:53.100593 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c62fa835-e885-49cb-b965-250febed577e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:53.106697 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c62fa835-e885-49cb-b965-250febed577e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:53.107424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c62fa835-e885-49cb-b965-250febed577e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:53.108393 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c62fa835-e885-49cb-b965-250febed577e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:53.108972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c62fa835-e885-49cb-b965-250febed577e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:53.218101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c62fa835-e885-49cb-b965-250febed577e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122018 Aug 04 16:28:53.218738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 386/781] 10.222.0.77 () {60 vars in 1316 bytes} [Wed Aug 4 16:28:53 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:28:53.988913 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:53.989617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:53.996503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:53.997074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:53.997912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:53.998390 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:54.333296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:54.341314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5456ca5b-4bea-4d3f-a3ed-99564289f5f7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.356171 Aug 04 16:28:54.341921 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 396/782] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:53 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:55.182748 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-81ea4b53-260c-4456-a733-af7761876e79 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:55.184501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-81ea4b53-260c-4456-a733-af7761876e79 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:55.185989 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-62c402d1-ecbf-4fea-8d48-115615855e46 req-d6591069-51b5-41df-9121-f89c8f89f9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dceabbf2-ecd4-497b-997a-1acbda49ddf9", "tag": "17e1d80b-51b6-4b09-b512-e218dc6eaeaa"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:55.189791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:28:55.189791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:28:55.192518 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81ea4b53-260c-4456-a733-af7761876e79 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:55.193093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81ea4b53-260c-4456-a733-af7761876e79 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:55.194112 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81ea4b53-260c-4456-a733-af7761876e79 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:55.195025 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81ea4b53-260c-4456-a733-af7761876e79 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:55.202071 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-62c402d1-ecbf-4fea-8d48-115615855e46 req-d6591069-51b5-41df-9121-f89c8f89f9e5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:55.205034 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-62c402d1-ecbf-4fea-8d48-115615855e46 req-d6591069-51b5-41df-9121-f89c8f89f9e5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:55.220160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-62c402d1-ecbf-4fea-8d48-115615855e46 req-d6591069-51b5-41df-9121-f89c8f89f9e5 service nova] Creating event network-changed:17e1d80b-51b6-4b09-b512-e218dc6eaeaa for instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 on hv-cinder-78956 Aug 04 16:28:55.227874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-62c402d1-ecbf-4fea-8d48-115615855e46 req-d6591069-51b5-41df-9121-f89c8f89f9e5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049792 Aug 04 16:28:55.228487 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 397/783] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:28:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:28:55.358960 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:55.359665 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:55.367033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:55.367687 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:55.369073 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:55.369692 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:55.607966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:55.615845 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-85421dde-fa1e-432a-97af-c58f730c84ac tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.261466 Aug 04 16:28:55.616431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 398/784] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:55 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:28:56.540215 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-81ea4b53-260c-4456-a733-af7761876e79 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 1.363086 Aug 04 16:28:56.541775 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 387/785] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:28:55 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:56.635709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:56.637005 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:56.645512 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:56.646425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:56.647541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:56.648259 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:57.164796 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:57.172558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a2372b65-4e6a-48ea-96a9-5ff7baedd94a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.543425 Aug 04 16:28:57.173191 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 399/786] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:56 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:57.554256 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-61b7f7c0-e437-4f3d-a3c9-474c9440df51 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:57.555502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-61b7f7c0-e437-4f3d-a3c9-474c9440df51 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:57.572197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61b7f7c0-e437-4f3d-a3c9-474c9440df51 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:57.572197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61b7f7c0-e437-4f3d-a3c9-474c9440df51 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:57.572197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61b7f7c0-e437-4f3d-a3c9-474c9440df51 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:57.572197 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61b7f7c0-e437-4f3d-a3c9-474c9440df51 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:57.642532 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-61b7f7c0-e437-4f3d-a3c9-474c9440df51 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.093193 Aug 04 16:28:57.643514 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 388/787] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:28:57 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:58.191221 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:58.191875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:58.199723 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:58.200177 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:58.200991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:58.201405 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:58.459836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:58.467474 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-138426be-f6e5-4cd5-a7c8-715096cb3f13 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.280852 Aug 04 16:28:58.468083 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 400/788] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:58 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:58.653430 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e1492858-337a-4869-a636-f30714720c19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:58.654550 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e1492858-337a-4869-a636-f30714720c19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:58.662823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1492858-337a-4869-a636-f30714720c19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:58.663249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1492858-337a-4869-a636-f30714720c19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:58.664215 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1492858-337a-4869-a636-f30714720c19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:58.664816 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e1492858-337a-4869-a636-f30714720c19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:58.751674 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e1492858-337a-4869-a636-f30714720c19 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.102183 Aug 04 16:28:58.752406 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 389/789] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:28:58 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:59.487462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:28:59.488191 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:59.496257 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:59.496870 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:59.498127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:59.499102 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:59.743589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:28:59.752393 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-264ecd16-6e51-451c-a928-8a914f7f5a01 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.269049 Aug 04 16:28:59.753097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 401/790] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:28:59 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:28:59.768575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0e681612-8dbb-42e5-9b91-fe9a43e7a289 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:28:59.770735 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0e681612-8dbb-42e5-9b91-fe9a43e7a289 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:28:59.785745 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e681612-8dbb-42e5-9b91-fe9a43e7a289 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:59.786373 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e681612-8dbb-42e5-9b91-fe9a43e7a289 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:59.787385 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e681612-8dbb-42e5-9b91-fe9a43e7a289 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:28:59.787813 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0e681612-8dbb-42e5-9b91-fe9a43e7a289 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:28:59.866721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0e681612-8dbb-42e5-9b91-fe9a43e7a289 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.105682 Aug 04 16:28:59.867517 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 390/791] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:28:59 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:00.769974 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:00.770587 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:00.776982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:00.778204 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:00.779094 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:00.779545 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:00.878592 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e9b4a78b-fee1-48dc-b31e-8d6596028d3b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:00.879716 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e9b4a78b-fee1-48dc-b31e-8d6596028d3b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:00.886501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e9b4a78b-fee1-48dc-b31e-8d6596028d3b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:00.886938 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e9b4a78b-fee1-48dc-b31e-8d6596028d3b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:00.887775 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e9b4a78b-fee1-48dc-b31e-8d6596028d3b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:00.888204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e9b4a78b-fee1-48dc-b31e-8d6596028d3b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:00.922880 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:00.934991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cb4cb956-17ae-40a2-affe-0beddeac1850 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.168737 Aug 04 16:29:00.936068 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 402/792] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:00 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:00.974171 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e9b4a78b-fee1-48dc-b31e-8d6596028d3b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.099656 Aug 04 16:29:00.974824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 391/793] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:00 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:29:01.273803 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-17b351de-e5d2-4e7b-b3a7-78c4e7ae8af5 req-9bc51d75-c4ab-433b-97c6-0d4736585c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cc5de9-b97f-4969-b926-672feb3d04e4", "name": "network-vif-plugged", "status": "completed", "tag": "e6adc942-2649-44f9-a5ef-fe285a7906d7"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:01.275859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:29:01.275859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:29:01.289646 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-17b351de-e5d2-4e7b-b3a7-78c4e7ae8af5 req-9bc51d75-c4ab-433b-97c6-0d4736585c18 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:01.290132 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-17b351de-e5d2-4e7b-b3a7-78c4e7ae8af5 req-9bc51d75-c4ab-433b-97c6-0d4736585c18 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:01.303528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-17b351de-e5d2-4e7b-b3a7-78c4e7ae8af5 req-9bc51d75-c4ab-433b-97c6-0d4736585c18 service nova] Creating event network-vif-plugged:e6adc942-2649-44f9-a5ef-fe285a7906d7 for instance 30cc5de9-b97f-4969-b926-672feb3d04e4 on hv-cinder-78956 Aug 04 16:29:01.311812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-17b351de-e5d2-4e7b-b3a7-78c4e7ae8af5 req-9bc51d75-c4ab-433b-97c6-0d4736585c18 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042262 Aug 04 16:29:01.312926 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 403/794] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:29:01.953255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:01.954323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:01.961392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:01.962165 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:01.962825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:01.963641 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:01.985916 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-70f7e6ae-c769-41d7-9e5e-9572ec0ac68a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:01.987054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-70f7e6ae-c769-41d7-9e5e-9572ec0ac68a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:01.994135 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-70f7e6ae-c769-41d7-9e5e-9572ec0ac68a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:01.994797 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-70f7e6ae-c769-41d7-9e5e-9572ec0ac68a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:01.995768 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-70f7e6ae-c769-41d7-9e5e-9572ec0ac68a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:01.996318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-70f7e6ae-c769-41d7-9e5e-9572ec0ac68a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:02.079284 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-70f7e6ae-c769-41d7-9e5e-9572ec0ac68a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.096947 Aug 04 16:29:02.083125 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 404/795] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:01 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:02.319186 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:02.330284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d43af7af-39d2-48bf-b8b2-abd3c4669557 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1260 microversion: 2.1 time: 0.380777 Aug 04 16:29:02.330739 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 392/796] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:01 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1260 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:03.096061 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bd717b61-862a-487a-9cf8-76115fe75276 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:03.097554 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-bd717b61-862a-487a-9cf8-76115fe75276 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:03.104501 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd717b61-862a-487a-9cf8-76115fe75276 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:03.104888 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd717b61-862a-487a-9cf8-76115fe75276 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:03.105655 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd717b61-862a-487a-9cf8-76115fe75276 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:03.106126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bd717b61-862a-487a-9cf8-76115fe75276 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:03.191567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-bd717b61-862a-487a-9cf8-76115fe75276 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.101988 Aug 04 16:29:03.192262 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 405/797] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:03 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:03.348150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:03.348757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:03.355576 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:03.356024 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:03.356825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:03.357252 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:03.509551 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:03.519723 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c879ad52-be54-4f14-99a7-e2e6169d4fd3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1444 microversion: 2.1 time: 0.175638 Aug 04 16:29:03.520400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 393/798] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:03 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:03.537224 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:03.537922 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:03.544961 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:03.545404 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:03.546227 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:03.546661 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:03.687706 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:03.695966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5fcf2922-da93-4365-ad45-732d1683fbc2 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1444 microversion: 2.1 time: 0.163117 Aug 04 16:29:03.696542 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 406/799] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:03 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:04.205511 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cf5bdd79-d430-4508-bd7f-0bfc4ef945b0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:04.207101 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cf5bdd79-d430-4508-bd7f-0bfc4ef945b0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:04.213683 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd79-d430-4508-bd7f-0bfc4ef945b0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:04.214162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd79-d430-4508-bd7f-0bfc4ef945b0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:04.214948 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd79-d430-4508-bd7f-0bfc4ef945b0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:04.215363 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd79-d430-4508-bd7f-0bfc4ef945b0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:04.284459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cf5bdd79-d430-4508-bd7f-0bfc4ef945b0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.083503 Aug 04 16:29:04.287873 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 394/800] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:04 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:05.295492 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f6740d97-c9e2-401d-bd9e-be112686d8d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:05.296643 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f6740d97-c9e2-401d-bd9e-be112686d8d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:05.305456 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6740d97-c9e2-401d-bd9e-be112686d8d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:05.306103 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6740d97-c9e2-401d-bd9e-be112686d8d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:05.306896 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6740d97-c9e2-401d-bd9e-be112686d8d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:05.307330 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6740d97-c9e2-401d-bd9e-be112686d8d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:05.382834 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f6740d97-c9e2-401d-bd9e-be112686d8d4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.091048 Aug 04 16:29:05.383602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 407/801] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:05 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:05.837899 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-7a4287ce-8661-4642-acf0-3b7e94f7e47a req-1768ffcf-dd57-4a4b-9207-6cf318eeb7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cc5de9-b97f-4969-b926-672feb3d04e4", "tag": "e6adc942-2649-44f9-a5ef-fe285a7906d7"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:05.839404 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:29:05.839404 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:29:05.847338 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-7a4287ce-8661-4642-acf0-3b7e94f7e47a req-1768ffcf-dd57-4a4b-9207-6cf318eeb7ab service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:05.847854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-7a4287ce-8661-4642-acf0-3b7e94f7e47a req-1768ffcf-dd57-4a4b-9207-6cf318eeb7ab service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:05.860458 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-7a4287ce-8661-4642-acf0-3b7e94f7e47a req-1768ffcf-dd57-4a4b-9207-6cf318eeb7ab service nova] Creating event network-changed:e6adc942-2649-44f9-a5ef-fe285a7906d7 for instance 30cc5de9-b97f-4969-b926-672feb3d04e4 on hv-cinder-78956 Aug 04 16:29:05.866338 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-7a4287ce-8661-4642-acf0-3b7e94f7e47a req-1768ffcf-dd57-4a4b-9207-6cf318eeb7ab service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032282 Aug 04 16:29:05.867355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 395/802] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:29:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:29:06.395061 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-4b3db7df-8681-47f9-b10d-1c657a142f17 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:06.396794 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-4b3db7df-8681-47f9-b10d-1c657a142f17 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:06.403715 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b3db7df-8681-47f9-b10d-1c657a142f17 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:06.404196 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b3db7df-8681-47f9-b10d-1c657a142f17 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:06.405052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b3db7df-8681-47f9-b10d-1c657a142f17 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:06.405548 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-4b3db7df-8681-47f9-b10d-1c657a142f17 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:06.478852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-4b3db7df-8681-47f9-b10d-1c657a142f17 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 14 microversion: 2.20 time: 0.087983 Aug 04 16:29:06.479520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 408/803] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:06 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:07.492361 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8abbef24-4b7b-4bb4-93d2-63c08e737bed tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:07.493257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8abbef24-4b7b-4bb4-93d2-63c08e737bed tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:07.499788 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8abbef24-4b7b-4bb4-93d2-63c08e737bed tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:07.500237 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8abbef24-4b7b-4bb4-93d2-63c08e737bed tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:07.501022 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8abbef24-4b7b-4bb4-93d2-63c08e737bed tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:07.501441 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8abbef24-4b7b-4bb4-93d2-63c08e737bed tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:07.577811 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8abbef24-4b7b-4bb4-93d2-63c08e737bed tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 6451 microversion: 2.20 time: 0.089856 Aug 04 16:29:07.578981 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 396/804] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:07 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 6451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:08.591524 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-83267296-4d64-4d2b-9837-682dfc981adf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:08.592447 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-83267296-4d64-4d2b-9837-682dfc981adf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:08.599465 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-83267296-4d64-4d2b-9837-682dfc981adf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:08.599910 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-83267296-4d64-4d2b-9837-682dfc981adf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:08.600680 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-83267296-4d64-4d2b-9837-682dfc981adf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:08.601105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-83267296-4d64-4d2b-9837-682dfc981adf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:08.665007 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-83267296-4d64-4d2b-9837-682dfc981adf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 13731 microversion: 2.20 time: 0.077943 Aug 04 16:29:08.665673 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 409/805] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:08 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 13731 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:09.680968 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2e3910d2-2c98-473c-9792-14aabc1ca6d0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:09.682017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2e3910d2-2c98-473c-9792-14aabc1ca6d0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:09.688874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e3910d2-2c98-473c-9792-14aabc1ca6d0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:09.689325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e3910d2-2c98-473c-9792-14aabc1ca6d0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:09.690127 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e3910d2-2c98-473c-9792-14aabc1ca6d0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:09.690562 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e3910d2-2c98-473c-9792-14aabc1ca6d0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:09.770452 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2e3910d2-2c98-473c-9792-14aabc1ca6d0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 17602 microversion: 2.20 time: 0.093938 Aug 04 16:29:09.771204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 397/806] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:09 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 17602 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:10.783666 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-09884ca9-77e5-41c6-8679-6e54efb4cc34 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:10.784631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-09884ca9-77e5-41c6-8679-6e54efb4cc34 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:10.792344 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-09884ca9-77e5-41c6-8679-6e54efb4cc34 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:10.792791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-09884ca9-77e5-41c6-8679-6e54efb4cc34 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:10.793569 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-09884ca9-77e5-41c6-8679-6e54efb4cc34 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:10.794031 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-09884ca9-77e5-41c6-8679-6e54efb4cc34 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:10.873998 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-09884ca9-77e5-41c6-8679-6e54efb4cc34 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 18155 microversion: 2.20 time: 0.094459 Aug 04 16:29:10.874967 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 410/807] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:10 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 18155 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:11.886046 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-16575365-f1e3-4340-bfbc-fb27b5542880 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:11.887064 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-16575365-f1e3-4340-bfbc-fb27b5542880 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:11.893617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-16575365-f1e3-4340-bfbc-fb27b5542880 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:11.894091 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-16575365-f1e3-4340-bfbc-fb27b5542880 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:11.894838 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-16575365-f1e3-4340-bfbc-fb27b5542880 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:11.895310 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-16575365-f1e3-4340-bfbc-fb27b5542880 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:11.963339 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-16575365-f1e3-4340-bfbc-fb27b5542880 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 19816 microversion: 2.20 time: 0.081185 Aug 04 16:29:11.964044 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 398/808] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:11 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 19816 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:12.977604 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e1fab465-9333-4486-b697-e8c8b02b6463 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:12.978622 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e1fab465-9333-4486-b697-e8c8b02b6463 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:12.985265 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e1fab465-9333-4486-b697-e8c8b02b6463 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:12.985705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e1fab465-9333-4486-b697-e8c8b02b6463 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:12.986504 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e1fab465-9333-4486-b697-e8c8b02b6463 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:12.986924 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e1fab465-9333-4486-b697-e8c8b02b6463 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:13.061813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e1fab465-9333-4486-b697-e8c8b02b6463 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 22119 microversion: 2.20 time: 0.088568 Aug 04 16:29:13.062503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 411/809] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:12 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 22119 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:14.073465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-44b895eb-3dae-4aeb-bf54-7a07e67bd653 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:14.075054 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-44b895eb-3dae-4aeb-bf54-7a07e67bd653 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:14.084968 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44b895eb-3dae-4aeb-bf54-7a07e67bd653 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:14.085575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44b895eb-3dae-4aeb-bf54-7a07e67bd653 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:14.086502 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44b895eb-3dae-4aeb-bf54-7a07e67bd653 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:14.086939 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-44b895eb-3dae-4aeb-bf54-7a07e67bd653 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:14.167601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-44b895eb-3dae-4aeb-bf54-7a07e67bd653 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 23235 microversion: 2.20 time: 0.097731 Aug 04 16:29:14.168468 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 399/810] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:14 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 23235 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:15.181058 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-744dc78a-afcd-4fde-abce-637b18daf133 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:15.182170 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-744dc78a-afcd-4fde-abce-637b18daf133 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:15.189314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-744dc78a-afcd-4fde-abce-637b18daf133 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:15.189755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-744dc78a-afcd-4fde-abce-637b18daf133 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:15.190617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-744dc78a-afcd-4fde-abce-637b18daf133 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:15.191090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-744dc78a-afcd-4fde-abce-637b18daf133 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:15.265462 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-744dc78a-afcd-4fde-abce-637b18daf133 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 24065 microversion: 2.20 time: 0.088693 Aug 04 16:29:15.266150 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 412/811] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:15 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 24065 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:29:16.278433 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-955134b2-2412-42ac-a54e-b517d164ae88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:16.279348 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-955134b2-2412-42ac-a54e-b517d164ae88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:16.286454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-955134b2-2412-42ac-a54e-b517d164ae88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:16.286902 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-955134b2-2412-42ac-a54e-b517d164ae88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:16.287675 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-955134b2-2412-42ac-a54e-b517d164ae88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:16.288110 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-955134b2-2412-42ac-a54e-b517d164ae88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:16.359994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-955134b2-2412-42ac-a54e-b517d164ae88 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 24852 microversion: 2.20 time: 0.086250 Aug 04 16:29:16.360660 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 400/812] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:16 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 24852 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:17.372561 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b798d194-b3a6-4c51-adce-31143c611935 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:17.373597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b798d194-b3a6-4c51-adce-31143c611935 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:17.380309 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b798d194-b3a6-4c51-adce-31143c611935 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:17.380751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b798d194-b3a6-4c51-adce-31143c611935 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:17.381531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b798d194-b3a6-4c51-adce-31143c611935 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:17.381969 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b798d194-b3a6-4c51-adce-31143c611935 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:17.458260 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b798d194-b3a6-4c51-adce-31143c611935 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 25823 microversion: 2.20 time: 0.089504 Aug 04 16:29:17.458843 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 413/813] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:17 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 25823 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:18.471056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-61214d7a-72d6-4b50-9a76-7f95ad9e955d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:18.472040 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-61214d7a-72d6-4b50-9a76-7f95ad9e955d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:18.479176 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61214d7a-72d6-4b50-9a76-7f95ad9e955d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:18.479617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61214d7a-72d6-4b50-9a76-7f95ad9e955d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:18.480380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61214d7a-72d6-4b50-9a76-7f95ad9e955d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:18.480803 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-61214d7a-72d6-4b50-9a76-7f95ad9e955d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:18.558497 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-61214d7a-72d6-4b50-9a76-7f95ad9e955d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 26623 microversion: 2.20 time: 0.091245 Aug 04 16:29:18.559187 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 401/814] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:18 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 26623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:19.674760 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-853a8a14-f2c7-4be3-815b-aa3112820836 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:19.675802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-853a8a14-f2c7-4be3-815b-aa3112820836 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:19.682398 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-853a8a14-f2c7-4be3-815b-aa3112820836 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:19.683015 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-853a8a14-f2c7-4be3-815b-aa3112820836 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:19.683812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-853a8a14-f2c7-4be3-815b-aa3112820836 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:19.684241 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-853a8a14-f2c7-4be3-815b-aa3112820836 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:19.752355 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-853a8a14-f2c7-4be3-815b-aa3112820836 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 27415 microversion: 2.20 time: 0.184778 Aug 04 16:29:19.752998 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 414/815] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:19 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 27415 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:20.765439 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-03fada03-ef24-481c-b0b9-aac0f6aa2256 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:20.766556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-03fada03-ef24-481c-b0b9-aac0f6aa2256 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:20.773418 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03fada03-ef24-481c-b0b9-aac0f6aa2256 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:20.773932 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03fada03-ef24-481c-b0b9-aac0f6aa2256 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:20.774941 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03fada03-ef24-481c-b0b9-aac0f6aa2256 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:20.775374 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-03fada03-ef24-481c-b0b9-aac0f6aa2256 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:20.866666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-03fada03-ef24-481c-b0b9-aac0f6aa2256 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28002 microversion: 2.20 time: 0.105192 Aug 04 16:29:20.867547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 402/816] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:20 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28002 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:29:21.644125 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:21.644731 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:21.654505 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:21.654937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:21.655732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:21.656340 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:21.684694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:29:21.765497 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fc4dfe38-ef67-4a17-a5db-da2f2730df28 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 204 len: 0 microversion: 2.1 time: 0.128228 Aug 04 16:29:21.766126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 415/817] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:29:21 2021] DELETE /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:29:21.776827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:21.777781 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:21.789178 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:21.789503 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:21.790455 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:21.790997 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:21.882586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8570715b-7582-476a-989b-4922b55f1b72 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:21.883669 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8570715b-7582-476a-989b-4922b55f1b72 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:21.890231 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8570715b-7582-476a-989b-4922b55f1b72 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:21.890679 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8570715b-7582-476a-989b-4922b55f1b72 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:21.891466 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8570715b-7582-476a-989b-4922b55f1b72 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:21.891893 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8570715b-7582-476a-989b-4922b55f1b72 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:21.948294 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:21.958749 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-884d03d9-d3cb-4d4d-b66d-3962a4db926d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1673 microversion: 2.1 time: 0.186687 Aug 04 16:29:21.959379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 403/818] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:21 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:21.960407 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8570715b-7582-476a-989b-4922b55f1b72 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28253 microversion: 2.20 time: 0.083043 Aug 04 16:29:21.961293 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 416/819] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:21 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28253 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:22.973583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3b4ecce7-82a5-4f71-84eb-df2ea581e499 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:22.975398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3b4ecce7-82a5-4f71-84eb-df2ea581e499 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:22.978945 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:22.980697 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:22.982424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b4ecce7-82a5-4f71-84eb-df2ea581e499 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:22.982842 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b4ecce7-82a5-4f71-84eb-df2ea581e499 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:22.983745 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b4ecce7-82a5-4f71-84eb-df2ea581e499 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:22.984065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b4ecce7-82a5-4f71-84eb-df2ea581e499 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:22.988261 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:22.988892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:22.989700 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:22.990191 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:23.052740 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3b4ecce7-82a5-4f71-84eb-df2ea581e499 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28253 microversion: 2.20 time: 0.082942 Aug 04 16:29:23.054443 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 404/820] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:22 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28253 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:23.119531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:23.127219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2c62c350-8e0f-41a3-80b1-69a3b7e02491 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1673 microversion: 2.1 time: 0.154228 Aug 04 16:29:23.127878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 417/821] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:22 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:29:24.065991 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b59ae558-f233-4a0b-9f35-5ad20ef53731 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:24.067003 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b59ae558-f233-4a0b-9f35-5ad20ef53731 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:24.075306 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b59ae558-f233-4a0b-9f35-5ad20ef53731 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:24.075703 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b59ae558-f233-4a0b-9f35-5ad20ef53731 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:24.076678 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b59ae558-f233-4a0b-9f35-5ad20ef53731 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:24.077226 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b59ae558-f233-4a0b-9f35-5ad20ef53731 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:24.144463 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:24.145872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:24.151388 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b59ae558-f233-4a0b-9f35-5ad20ef53731 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28253 microversion: 2.20 time: 0.089339 Aug 04 16:29:24.152578 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 405/822] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:24 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:24.160367 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:24.160857 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:24.161695 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:24.162328 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:24.321180 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:24.332635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3a096a23-c3ae-43a4-9982-724dcf045002 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1673 microversion: 2.1 time: 0.192230 Aug 04 16:29:24.333228 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 418/823] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:24 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:25.137003 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-2b588377-f20e-4754-9e99-21e2a6454958 req-d95be725-5933-483a-a4fe-13894708df1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee88d756-5674-4fae-a650-a006454697e6", "name": "network-vif-deleted", "tag": "63945f38-3e20-498c-9928-cc55b45b7533"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:25.140029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:29:25.140029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:29:25.150186 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-2b588377-f20e-4754-9e99-21e2a6454958 req-d95be725-5933-483a-a4fe-13894708df1c service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:25.150953 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-2b588377-f20e-4754-9e99-21e2a6454958 req-d95be725-5933-483a-a4fe-13894708df1c service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:25.171084 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-168a99ce-c6d5-426b-9dcf-21e8db752f9a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:25.178998 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-168a99ce-c6d5-426b-9dcf-21e8db752f9a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:25.187321 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-168a99ce-c6d5-426b-9dcf-21e8db752f9a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:25.188134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-168a99ce-c6d5-426b-9dcf-21e8db752f9a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:25.189382 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-168a99ce-c6d5-426b-9dcf-21e8db752f9a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:25.192219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-168a99ce-c6d5-426b-9dcf-21e8db752f9a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:25.192414 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-2b588377-f20e-4754-9e99-21e2a6454958 req-d95be725-5933-483a-a4fe-13894708df1c service nova] Creating event network-vif-deleted:63945f38-3e20-498c-9928-cc55b45b7533 for instance ee88d756-5674-4fae-a650-a006454697e6 on hv-cinder-78956 Aug 04 16:29:25.198598 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-2b588377-f20e-4754-9e99-21e2a6454958 req-d95be725-5933-483a-a4fe-13894708df1c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163025 Aug 04 16:29:25.199639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 406/824] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:29:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:29:25.266183 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-168a99ce-c6d5-426b-9dcf-21e8db752f9a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28543 microversion: 2.20 time: 0.102788 Aug 04 16:29:25.267900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 419/825] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:25 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28543 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:25.360862 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:25.361578 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:25.369583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:25.371492 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:25.373086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:25.373911 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:25.426711 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:25.427512 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:25.428340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lazy-loading 'fault' on Instance uuid ee88d756-5674-4fae-a650-a006454697e6 {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:29:25.489392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:25.503273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-628c0f91-9fb6-4137-ad0b-be12742d4913 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 200 len: 1327 microversion: 2.1 time: 0.147674 Aug 04 16:29:25.504115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 407/826] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:25 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:26.280357 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b8051eec-5080-446a-b988-100de2851ee4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:26.282068 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b8051eec-5080-446a-b988-100de2851ee4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:26.288261 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8051eec-5080-446a-b988-100de2851ee4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:26.288708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8051eec-5080-446a-b988-100de2851ee4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:26.289477 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8051eec-5080-446a-b988-100de2851ee4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:26.289908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8051eec-5080-446a-b988-100de2851ee4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:26.363885 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b8051eec-5080-446a-b988-100de2851ee4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28669 microversion: 2.20 time: 0.088197 Aug 04 16:29:26.364541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 420/827] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:26 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28669 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:26.526255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:26.526880 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:26.533908 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:26.534379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:26.535243 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:26.535677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:26.551017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] HTTP exception thrown: Instance ee88d756-5674-4fae-a650-a006454697e6 could not be found. Aug 04 16:29:26.551617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Returning 404 to user: Instance ee88d756-5674-4fae-a650-a006454697e6 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:29:26.552459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4a4b3e3d-fab2-438a-864b-ddd53feb01f6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 404 len: 111 microversion: 2.1 time: 0.030658 Aug 04 16:29:26.553003 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 408/828] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:26 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:29:26.562672 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-116887c5-adfa-4f87-824c-2df2904dedcc tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '.version_select at 0x7f27181b6e50>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:26.585472 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-116887c5-adfa-4f87-824c-2df2904dedcc tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005129936" status: 202 len: 0 microversion: 2.1 time: 0.026770 Aug 04 16:29:26.586385 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 421/829] 10.222.0.77 () {58 vars in 1221 bytes} [Wed Aug 4 16:29:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005129936 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:27.345611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-bda669fd-c640-4f06-8b4f-a764b569ebab tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'create', calling method: .version_select at 0x7f2718219d30>, body: {"keypair": {"name": "tempest-keypair-1261278869"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:27.364797 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-bda669fd-c640-4f06-8b4f-a764b569ebab tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:29:27.370555 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-bda669fd-c640-4f06-8b4f-a764b569ebab tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for user aa31f19acc464a5eb0f2620d763a964d and project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:29:27.378470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a9a73963-02e7-4ba7-8a7a-f4a4652efe8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:27.380114 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a9a73963-02e7-4ba7-8a7a-f4a4652efe8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:27.387802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9a73963-02e7-4ba7-8a7a-f4a4652efe8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:27.388299 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9a73963-02e7-4ba7-8a7a-f4a4652efe8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:27.389072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9a73963-02e7-4ba7-8a7a-f4a4652efe8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:27.389496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9a73963-02e7-4ba7-8a7a-f4a4652efe8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:27.468875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a9a73963-02e7-4ba7-8a7a-f4a4652efe8a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28711 microversion: 2.20 time: 0.095152 Aug 04 16:29:27.474394 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 422/830] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:27 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28711 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:27.541644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-bda669fd-c640-4f06-8b4f-a764b569ebab tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:29:27.545268 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-bda669fd-c640-4f06-8b4f-a764b569ebab tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for user aa31f19acc464a5eb0f2620d763a964d and project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:29:27.558980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-bda669fd-c640-4f06-8b4f-a764b569ebab tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.217029 Aug 04 16:29:27.559784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 409/831] 10.222.0.77 () {60 vars in 1158 bytes} [Wed Aug 4 16:29:27 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:28.484209 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8249fb01-d4af-4e27-aa15-a3ae4a21447d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:28.485311 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8249fb01-d4af-4e27-aa15-a3ae4a21447d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:28.492053 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8249fb01-d4af-4e27-aa15-a3ae4a21447d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:28.492499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8249fb01-d4af-4e27-aa15-a3ae4a21447d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:28.493276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8249fb01-d4af-4e27-aa15-a3ae4a21447d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:28.493707 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8249fb01-d4af-4e27-aa15-a3ae4a21447d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:28.565338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8249fb01-d4af-4e27-aa15-a3ae4a21447d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28711 microversion: 2.20 time: 0.084746 Aug 04 16:29:28.566716 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 423/832] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:28 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28711 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:29.017999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-882604662", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c2558c7-24ce-41b2-b792-f9920a95bb2f"}], "security_groups": [{"name": "tempest-securitygroup--516343555"}], "key_name": "tempest-keypair-1261278869", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:29.118155 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] validate_networks() for [('5c2558c7-24ce-41b2-b792-f9920a95bb2f', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:29:29.582464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-22d10209-18b6-43db-abdc-078055122255 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:29.583726 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-22d10209-18b6-43db-abdc-078055122255 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:29.592115 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d10209-18b6-43db-abdc-078055122255 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:29.592667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d10209-18b6-43db-abdc-078055122255 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:29.593568 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d10209-18b6-43db-abdc-078055122255 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:29.594137 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22d10209-18b6-43db-abdc-078055122255 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:29.644576 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:29:29.645440 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:29:29.646406 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:29:29.646949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:29:29.647893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:29:29.663185 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:29.663680 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:29.664929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:29.665684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:29.678177 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-22d10209-18b6-43db-abdc-078055122255 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28711 microversion: 2.20 time: 0.103795 Aug 04 16:29:29.679086 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 424/833] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:29 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28711 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:29:29.694030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:29:29.701529 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Getting quotas for user aa31f19acc464a5eb0f2620d763a964d and project fa8a2bb840264572bbf79ff732ee6fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:29:29.718429 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:29:29.720939 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:29:29.767797 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3b6751b9-76b5-4b46-bec4-588cd3eda2b8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.754158 Aug 04 16:29:29.768566 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 410/834] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:29:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:29:29.779155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1f841ef9-a4c9-45fb-b2b5-9573d2117cb3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:29.779849 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1f841ef9-a4c9-45fb-b2b5-9573d2117cb3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:29.840043 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1f841ef9-a4c9-45fb-b2b5-9573d2117cb3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:29.847205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1f841ef9-a4c9-45fb-b2b5-9573d2117cb3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1237 microversion: 2.1 time: 0.072221 Aug 04 16:29:29.847784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 425/835] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:29 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:30.690812 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fcba44e9-a915-4ff9-9633-e79b7bdb2342 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:30.692436 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fcba44e9-a915-4ff9-9633-e79b7bdb2342 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:30.699014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fcba44e9-a915-4ff9-9633-e79b7bdb2342 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:30.699458 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fcba44e9-a915-4ff9-9633-e79b7bdb2342 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:30.700230 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fcba44e9-a915-4ff9-9633-e79b7bdb2342 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:30.700877 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fcba44e9-a915-4ff9-9633-e79b7bdb2342 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:30.768635 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fcba44e9-a915-4ff9-9633-e79b7bdb2342 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 28711 microversion: 2.20 time: 0.081327 Aug 04 16:29:30.769180 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 411/836] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:30 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 28711 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:30.866566 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:30.868127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:30.879500 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:30.880212 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:30.881390 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:30.882043 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:30.955290 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:30.967361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1e23be87-f0b7-4b94-b2be-083a44efdc47 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1289 microversion: 2.1 time: 0.105927 Aug 04 16:29:30.968507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 426/837] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:30 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:31.785133 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8e7991eb-d5c6-4cad-9b48-40b1177aca00 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:31.786223 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8e7991eb-d5c6-4cad-9b48-40b1177aca00 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:31.794684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e7991eb-d5c6-4cad-9b48-40b1177aca00 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:31.795159 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e7991eb-d5c6-4cad-9b48-40b1177aca00 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:31.795960 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e7991eb-d5c6-4cad-9b48-40b1177aca00 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:31.796498 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e7991eb-d5c6-4cad-9b48-40b1177aca00 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:31.870001 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8e7991eb-d5c6-4cad-9b48-40b1177aca00 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 30167 microversion: 2.20 time: 0.091755 Aug 04 16:29:31.870777 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 412/838] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:31 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 30167 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:31.985526 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:31.986147 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:31.992398 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:31.992843 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:31.993617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:31.994087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:32.149211 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:32.163074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b8470467-d2cb-43ec-aca3-1bd07b78304a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.181083 Aug 04 16:29:32.163798 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 427/839] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:31 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:32.587177 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-9b5d3370-1472-4e06-a28a-4d81957ed140 req-01ef0004-ace5-4dae-b29e-aa7abcc30806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b", "tag": "861bc984-e35a-4369-9f94-3889ac7bd84c"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:32.588762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:29:32.588762 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:29:32.602684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-9b5d3370-1472-4e06-a28a-4d81957ed140 req-01ef0004-ace5-4dae-b29e-aa7abcc30806 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:32.603086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-9b5d3370-1472-4e06-a28a-4d81957ed140 req-01ef0004-ace5-4dae-b29e-aa7abcc30806 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:32.615887 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-9b5d3370-1472-4e06-a28a-4d81957ed140 req-01ef0004-ace5-4dae-b29e-aa7abcc30806 service nova] Creating event network-changed:861bc984-e35a-4369-9f94-3889ac7bd84c for instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b on hv-cinder-78956 Aug 04 16:29:32.622466 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-9b5d3370-1472-4e06-a28a-4d81957ed140 req-01ef0004-ace5-4dae-b29e-aa7abcc30806 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038958 Aug 04 16:29:32.623345 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 413/840] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:29:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:29:32.881769 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b63d9af7-69e0-4be7-a114-196c15e8c6ea tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:32.882771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b63d9af7-69e0-4be7-a114-196c15e8c6ea tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:32.896127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b63d9af7-69e0-4be7-a114-196c15e8c6ea tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:32.896127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b63d9af7-69e0-4be7-a114-196c15e8c6ea tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:32.896127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b63d9af7-69e0-4be7-a114-196c15e8c6ea tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:32.896127 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b63d9af7-69e0-4be7-a114-196c15e8c6ea tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:32.967970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b63d9af7-69e0-4be7-a114-196c15e8c6ea tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 31802 microversion: 2.20 time: 0.089663 Aug 04 16:29:32.968619 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 428/841] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:32 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 31802 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:33.184802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:33.184802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:33.193612 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:33.194434 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:33.195806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:33.197582 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:33.471394 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:33.480688 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-91a56118-c8ef-416f-ac4c-6fa32b6715f4 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.302303 Aug 04 16:29:33.490802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 414/842] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:33 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:33.981837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1987c2c3-5c3a-479d-bb0b-fc841cc09ac2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:33.982866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1987c2c3-5c3a-479d-bb0b-fc841cc09ac2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:33.990057 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1987c2c3-5c3a-479d-bb0b-fc841cc09ac2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:33.990490 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1987c2c3-5c3a-479d-bb0b-fc841cc09ac2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:33.991274 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1987c2c3-5c3a-479d-bb0b-fc841cc09ac2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:33.991724 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1987c2c3-5c3a-479d-bb0b-fc841cc09ac2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:34.074485 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1987c2c3-5c3a-479d-bb0b-fc841cc09ac2 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 32556 microversion: 2.20 time: 0.096805 Aug 04 16:29:34.075269 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 429/843] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:33 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 32556 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:34.500387 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:34.501047 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:34.508528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:34.508976 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:34.510175 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:34.510465 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:34.656225 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:34.663571 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-55dd94e9-a6f7-400e-8dcb-bf967d42cbf6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.167145 Aug 04 16:29:34.664142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 415/844] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:34 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:35.089585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ca72bbcd-a003-4349-b70e-437aa423fb87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:35.090603 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ca72bbcd-a003-4349-b70e-437aa423fb87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:35.097695 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca72bbcd-a003-4349-b70e-437aa423fb87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:35.098168 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca72bbcd-a003-4349-b70e-437aa423fb87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:35.098954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca72bbcd-a003-4349-b70e-437aa423fb87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:35.099384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ca72bbcd-a003-4349-b70e-437aa423fb87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:35.176175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ca72bbcd-a003-4349-b70e-437aa423fb87 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 33384 microversion: 2.20 time: 0.091717 Aug 04 16:29:35.177107 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 430/845] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:35 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 33384 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:35.680892 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:35.681504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:35.688429 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:35.688877 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:35.689647 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:35.690087 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:35.815978 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:35.828770 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-19a5b2ae-63a7-4fb4-b6f0-2992a0293c8c tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.151547 Aug 04 16:29:35.829321 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 416/846] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:35 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:36.191058 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c4191251-54f4-4bdb-ac4c-38647b3f4e28 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:36.192283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c4191251-54f4-4bdb-ac4c-38647b3f4e28 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:36.201059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c4191251-54f4-4bdb-ac4c-38647b3f4e28 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:36.201431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c4191251-54f4-4bdb-ac4c-38647b3f4e28 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:36.202258 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c4191251-54f4-4bdb-ac4c-38647b3f4e28 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:36.203023 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c4191251-54f4-4bdb-ac4c-38647b3f4e28 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:36.271666 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c4191251-54f4-4bdb-ac4c-38647b3f4e28 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 34626 microversion: 2.20 time: 0.085371 Aug 04 16:29:36.272324 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 431/847] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:36 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 34626 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:36.848429 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:36.849106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:36.856264 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:36.856964 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:36.857852 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:36.858408 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:36.993940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:37.002424 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-267d94f9-e66a-4293-930e-b1ac5876ea04 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.159802 Aug 04 16:29:37.003024 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 417/848] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:36 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:37.288854 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f17d1f19-d105-45f6-afeb-e3744cbdde25 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:37.289892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f17d1f19-d105-45f6-afeb-e3744cbdde25 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:37.298228 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f17d1f19-d105-45f6-afeb-e3744cbdde25 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:37.298678 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f17d1f19-d105-45f6-afeb-e3744cbdde25 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:37.299470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f17d1f19-d105-45f6-afeb-e3744cbdde25 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:37.299896 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f17d1f19-d105-45f6-afeb-e3744cbdde25 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:37.372323 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f17d1f19-d105-45f6-afeb-e3744cbdde25 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 35799 microversion: 2.20 time: 0.088701 Aug 04 16:29:37.373165 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 432/849] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:37 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 35799 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:38.021320 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:38.021872 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:38.028444 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:38.029072 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:38.029853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:38.030309 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:38.158696 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:38.166461 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-0bfab089-5ac3-4c3d-bebd-881c05fec46e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.148926 Aug 04 16:29:38.175592 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 418/850] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:38 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:38.386090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-67b87836-05b4-4196-8d5e-3d9004966cd6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:38.387875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-67b87836-05b4-4196-8d5e-3d9004966cd6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:38.396996 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67b87836-05b4-4196-8d5e-3d9004966cd6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:38.397450 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67b87836-05b4-4196-8d5e-3d9004966cd6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:38.398264 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67b87836-05b4-4196-8d5e-3d9004966cd6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:38.398695 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67b87836-05b4-4196-8d5e-3d9004966cd6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:38.477739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-67b87836-05b4-4196-8d5e-3d9004966cd6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 36915 microversion: 2.20 time: 0.096200 Aug 04 16:29:38.481998 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 433/851] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:38 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 36915 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:39.183550 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:39.184134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:39.190832 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:39.191276 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:39.192054 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:39.192484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:39.321655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:39.331243 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4a962333-768b-421a-8186-c988cdc4a467 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.150985 Aug 04 16:29:39.331820 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 419/852] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:39 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:39.488917 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4b9b12dc-19ce-43df-8ae1-468b7fdea5d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:39.489846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4b9b12dc-19ce-43df-8ae1-468b7fdea5d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:39.495837 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b9b12dc-19ce-43df-8ae1-468b7fdea5d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:39.496278 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b9b12dc-19ce-43df-8ae1-468b7fdea5d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:39.497155 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b9b12dc-19ce-43df-8ae1-468b7fdea5d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:39.497520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4b9b12dc-19ce-43df-8ae1-468b7fdea5d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:39.562423 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4b9b12dc-19ce-43df-8ae1-468b7fdea5d6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 38099 microversion: 2.20 time: 0.077015 Aug 04 16:29:39.563093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 420/853] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:39 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 38099 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:39.581414 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-a5cc53d2-413e-411c-977e-c50d7f81133b req-52e41d54-e931-4903-bfcd-f86e33eadd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b", "name": "network-vif-plugged", "status": "completed", "tag": "861bc984-e35a-4369-9f94-3889ac7bd84c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:39.582934 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:29:39.582934 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:29:39.591418 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-a5cc53d2-413e-411c-977e-c50d7f81133b req-52e41d54-e931-4903-bfcd-f86e33eadd89 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:39.592520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-a5cc53d2-413e-411c-977e-c50d7f81133b req-52e41d54-e931-4903-bfcd-f86e33eadd89 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:39.608519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-a5cc53d2-413e-411c-977e-c50d7f81133b req-52e41d54-e931-4903-bfcd-f86e33eadd89 service nova] Creating event network-vif-plugged:861bc984-e35a-4369-9f94-3889ac7bd84c for instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b on hv-cinder-78956 Aug 04 16:29:39.614293 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-a5cc53d2-413e-411c-977e-c50d7f81133b req-52e41d54-e931-4903-bfcd-f86e33eadd89 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224285 Aug 04 16:29:39.615256 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 434/854] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:29:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:29:40.349450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:40.350237 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:40.357586 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:40.358062 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:40.358841 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:40.359266 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:40.485869 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:40.496400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-25abc628-327c-43a1-88ab-9abd2703f805 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1362 microversion: 2.1 time: 0.150972 Aug 04 16:29:40.497096 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 421/855] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:40 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:40.579916 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-95a1e87b-46ce-4f66-a932-4292d18659fa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:40.581365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-95a1e87b-46ce-4f66-a932-4292d18659fa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:40.593863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95a1e87b-46ce-4f66-a932-4292d18659fa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:40.594543 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95a1e87b-46ce-4f66-a932-4292d18659fa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:40.595105 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95a1e87b-46ce-4f66-a932-4292d18659fa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:40.595525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-95a1e87b-46ce-4f66-a932-4292d18659fa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:40.668946 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-95a1e87b-46ce-4f66-a932-4292d18659fa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 38258 microversion: 2.20 time: 0.095977 Aug 04 16:29:40.669593 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 435/856] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:40 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 38258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:41.513798 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:41.514480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:41.521229 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:41.521675 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:41.522491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:41.522922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:41.662257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:41.670546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e5fb34f3-9304-410a-99c7-455d5719e617 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1547 microversion: 2.1 time: 0.160573 Aug 04 16:29:41.671102 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 422/857] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:29:41 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:41.681278 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5f393782-da44-4ce1-b96b-af26c7246014 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:41.682294 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5f393782-da44-4ce1-b96b-af26c7246014 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:41.686936 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-389d4fa3-e448-4888-ab88-95ef367b1923 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:41.687569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-389d4fa3-e448-4888-ab88-95ef367b1923 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:41.690155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5f393782-da44-4ce1-b96b-af26c7246014 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:41.690611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5f393782-da44-4ce1-b96b-af26c7246014 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:41.691396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5f393782-da44-4ce1-b96b-af26c7246014 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:41.691828 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5f393782-da44-4ce1-b96b-af26c7246014 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:41.693977 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-389d4fa3-e448-4888-ab88-95ef367b1923 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:41.694767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-389d4fa3-e448-4888-ab88-95ef367b1923 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:41.695555 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-389d4fa3-e448-4888-ab88-95ef367b1923 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:41.695988 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-389d4fa3-e448-4888-ab88-95ef367b1923 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:41.761799 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5f393782-da44-4ce1-b96b-af26c7246014 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 38258 microversion: 2.20 time: 0.084434 Aug 04 16:29:41.763053 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 436/858] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:41 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 38258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:41.787055 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-389d4fa3-e448-4888-ab88-95ef367b1923 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103750 Aug 04 16:29:41.787538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 423/859] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 4 16:29:41 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:29:42.775287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d707be0d-51ba-4419-b4b1-3f314da0fc40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:42.776321 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d707be0d-51ba-4419-b4b1-3f314da0fc40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:42.784475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d707be0d-51ba-4419-b4b1-3f314da0fc40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:42.784802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d707be0d-51ba-4419-b4b1-3f314da0fc40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:42.785826 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d707be0d-51ba-4419-b4b1-3f314da0fc40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:42.786484 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d707be0d-51ba-4419-b4b1-3f314da0fc40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:42.789348 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7f1e20b3-4854-45c5-9010-1991ea1c9952 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:42.790414 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7f1e20b3-4854-45c5-9010-1991ea1c9952 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:42.797372 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f1e20b3-4854-45c5-9010-1991ea1c9952 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:42.797818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f1e20b3-4854-45c5-9010-1991ea1c9952 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:42.798625 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f1e20b3-4854-45c5-9010-1991ea1c9952 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:42.799047 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7f1e20b3-4854-45c5-9010-1991ea1c9952 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:42.872586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d707be0d-51ba-4419-b4b1-3f314da0fc40 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 38337 microversion: 2.20 time: 0.100603 Aug 04 16:29:42.873650 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 437/860] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:42 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 38337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:42.878410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7f1e20b3-4854-45c5-9010-1991ea1c9952 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.093046 Aug 04 16:29:42.879413 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 424/861] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:42 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:42.955226 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-99306a69-56c1-4a50-b510-456d4dffefa5 req-b0694d5a-4bed-43f3-b663-a5d6cf9281ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b", "tag": "861bc984-e35a-4369-9f94-3889ac7bd84c"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:42.956728 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:29:42.956728 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:29:42.964480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-99306a69-56c1-4a50-b510-456d4dffefa5 req-b0694d5a-4bed-43f3-b663-a5d6cf9281ac service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:42.965219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-99306a69-56c1-4a50-b510-456d4dffefa5 req-b0694d5a-4bed-43f3-b663-a5d6cf9281ac service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:42.977756 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-99306a69-56c1-4a50-b510-456d4dffefa5 req-b0694d5a-4bed-43f3-b663-a5d6cf9281ac service nova] Creating event network-changed:861bc984-e35a-4369-9f94-3889ac7bd84c for instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b on hv-cinder-78956 Aug 04 16:29:42.983017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-99306a69-56c1-4a50-b510-456d4dffefa5 req-b0694d5a-4bed-43f3-b663-a5d6cf9281ac service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107414 Aug 04 16:29:42.983658 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 438/862] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:29:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:29:43.887402 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f7eb1f27-5fee-470a-91d8-7c70d1fa6d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:43.888438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f7eb1f27-5fee-470a-91d8-7c70d1fa6d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:43.891909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-31dcffa1-e29e-4479-b5d4-da18ad16c794 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:43.893552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-31dcffa1-e29e-4479-b5d4-da18ad16c794 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:43.895454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f7eb1f27-5fee-470a-91d8-7c70d1fa6d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:43.895898 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f7eb1f27-5fee-470a-91d8-7c70d1fa6d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:43.897025 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f7eb1f27-5fee-470a-91d8-7c70d1fa6d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:43.897515 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f7eb1f27-5fee-470a-91d8-7c70d1fa6d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:43.900377 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31dcffa1-e29e-4479-b5d4-da18ad16c794 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:43.900825 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31dcffa1-e29e-4479-b5d4-da18ad16c794 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:43.901874 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31dcffa1-e29e-4479-b5d4-da18ad16c794 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:43.902507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-31dcffa1-e29e-4479-b5d4-da18ad16c794 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:43.969201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-31dcffa1-e29e-4479-b5d4-da18ad16c794 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.082231 Aug 04 16:29:43.969991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 439/863] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:43 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:43.982491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f7eb1f27-5fee-470a-91d8-7c70d1fa6d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 200 len: 38401 microversion: 2.20 time: 0.099800 Aug 04 16:29:43.987948 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 425/864] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:43 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 38401 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:29:43.993727 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f541c0d5-91ff-436d-b0a5-0a084c7b89b7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:43.994332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f541c0d5-91ff-436d-b0a5-0a084c7b89b7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:44.001217 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f541c0d5-91ff-436d-b0a5-0a084c7b89b7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:44.001694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f541c0d5-91ff-436d-b0a5-0a084c7b89b7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:44.002498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f541c0d5-91ff-436d-b0a5-0a084c7b89b7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:44.002920 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f541c0d5-91ff-436d-b0a5-0a084c7b89b7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:44.031781 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f541c0d5-91ff-436d-b0a5-0a084c7b89b7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/ips" status: 200 len: 150 microversion: 2.20 time: 0.042217 Aug 04 16:29:44.032480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 440/865] 10.222.0.77 () {60 vars in 1289 bytes} [Wed Aug 4 16:29:43 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:29:44.981108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3183c77b-042d-4d2f-aaa4-b0669e8f85a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:44.982150 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3183c77b-042d-4d2f-aaa4-b0669e8f85a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:44.989256 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3183c77b-042d-4d2f-aaa4-b0669e8f85a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:44.989706 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3183c77b-042d-4d2f-aaa4-b0669e8f85a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:44.990540 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3183c77b-042d-4d2f-aaa4-b0669e8f85a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:44.990972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3183c77b-042d-4d2f-aaa4-b0669e8f85a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:45.052546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3183c77b-042d-4d2f-aaa4-b0669e8f85a9 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.075377 Aug 04 16:29:45.053159 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 426/866] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:44 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:46.068586 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c2132c7e-edbb-4dfd-8a41-c6cbd50aad3d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:46.069502 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c2132c7e-edbb-4dfd-8a41-c6cbd50aad3d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:46.078468 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2132c7e-edbb-4dfd-8a41-c6cbd50aad3d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:46.078923 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2132c7e-edbb-4dfd-8a41-c6cbd50aad3d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:46.079712 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2132c7e-edbb-4dfd-8a41-c6cbd50aad3d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:46.080140 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2132c7e-edbb-4dfd-8a41-c6cbd50aad3d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:46.148769 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c2132c7e-edbb-4dfd-8a41-c6cbd50aad3d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.084027 Aug 04 16:29:46.149476 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 441/867] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:46 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:46.201612 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:46.202632 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:46.209683 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:46.210168 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:46.210974 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:46.211404 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:46.236302 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lazy-loading 'flavor' on Instance uuid dceabbf2-ecd4-497b-997a-1acbda49ddf9 {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:29:46.514594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-92e6bb0d-dfee-4260-b53a-c3344f414a93 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 202 len: 0 microversion: 2.20 time: 0.316941 Aug 04 16:29:46.515256 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 427/868] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:29:46 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:29:46.528420 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:46.529674 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:46.539096 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:46.539527 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:46.540712 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:46.541323 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:46.686783 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:46.694915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:46.696389 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:46.697559 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-e58c30c2-61ed-40c8-b629-ca31115a1e07 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.177081 Aug 04 16:29:46.698153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 442/869] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:46 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:47.160921 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-46128df4-7c87-4a2d-a18e-2fc4bece5802 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:47.161922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-46128df4-7c87-4a2d-a18e-2fc4bece5802 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:47.168780 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-46128df4-7c87-4a2d-a18e-2fc4bece5802 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:47.169227 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-46128df4-7c87-4a2d-a18e-2fc4bece5802 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:47.169988 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-46128df4-7c87-4a2d-a18e-2fc4bece5802 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:47.170454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-46128df4-7c87-4a2d-a18e-2fc4bece5802 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:47.235329 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-46128df4-7c87-4a2d-a18e-2fc4bece5802 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.078413 Aug 04 16:29:47.236014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 428/870] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:47 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:47.717203 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:47.717804 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:47.724521 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:47.724978 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:47.725755 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:47.726229 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:47.855032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:47.863635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:47.865116 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:47.866272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fb4df491-bcaa-4ae5-98ff-4488b292cf2b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.153035 Aug 04 16:29:47.866807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 443/871] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:47 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:29:48.248140 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5b5ecae4-cdba-4cb8-a2f3-0c49708bbd20 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:48.249169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5b5ecae4-cdba-4cb8-a2f3-0c49708bbd20 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:48.256051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b5ecae4-cdba-4cb8-a2f3-0c49708bbd20 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:48.256497 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b5ecae4-cdba-4cb8-a2f3-0c49708bbd20 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:48.257267 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b5ecae4-cdba-4cb8-a2f3-0c49708bbd20 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:48.257696 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5b5ecae4-cdba-4cb8-a2f3-0c49708bbd20 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:48.325063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5b5ecae4-cdba-4cb8-a2f3-0c49708bbd20 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.080951 Aug 04 16:29:48.325919 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 429/872] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:48 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:48.885253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:48.886009 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:48.893112 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:48.893560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:48.894398 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:48.894837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:49.027866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:49.037191 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:49.038539 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:49.039691 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-951ae893-9c30-4236-8d19-80c020289a41 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.158334 Aug 04 16:29:49.040258 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 444/873] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:48 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:49.338983 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f54137a2-72b1-4438-9cc7-54cbcacfd142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:49.340892 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f54137a2-72b1-4438-9cc7-54cbcacfd142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:49.351914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f54137a2-72b1-4438-9cc7-54cbcacfd142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:49.352653 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f54137a2-72b1-4438-9cc7-54cbcacfd142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:49.353900 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f54137a2-72b1-4438-9cc7-54cbcacfd142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:49.354644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f54137a2-72b1-4438-9cc7-54cbcacfd142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:49.423289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f54137a2-72b1-4438-9cc7-54cbcacfd142 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.089687 Aug 04 16:29:49.423931 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 430/874] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:49 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:50.057751 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:50.058399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:50.065171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:50.065617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:50.066431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:50.066872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:50.197592 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:50.206644 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:50.208134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:50.209288 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0f0bd15b-318a-4166-af4c-c91bfc6063aa tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.155444 Aug 04 16:29:50.209883 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 445/875] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:50 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:50.435532 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-37771190-5cf3-4bb5-9c9c-5d29a74495c6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:50.436560 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-37771190-5cf3-4bb5-9c9c-5d29a74495c6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:50.443606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37771190-5cf3-4bb5-9c9c-5d29a74495c6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:50.444031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37771190-5cf3-4bb5-9c9c-5d29a74495c6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:50.444810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37771190-5cf3-4bb5-9c9c-5d29a74495c6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:50.445240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-37771190-5cf3-4bb5-9c9c-5d29a74495c6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:50.520656 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-37771190-5cf3-4bb5-9c9c-5d29a74495c6 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.089286 Aug 04 16:29:50.521490 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 431/876] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:50 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:51.233864 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:51.235016 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:51.244728 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:51.245542 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:51.247172 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:51.247974 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:51.534174 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e2222c86-e455-434b-b398-8811286d9d99 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:51.535381 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e2222c86-e455-434b-b398-8811286d9d99 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:51.543147 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2222c86-e455-434b-b398-8811286d9d99 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:51.543619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2222c86-e455-434b-b398-8811286d9d99 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:51.544500 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2222c86-e455-434b-b398-8811286d9d99 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:51.544926 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2222c86-e455-434b-b398-8811286d9d99 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:51.618505 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e2222c86-e455-434b-b398-8811286d9d99 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.089417 Aug 04 16:29:51.619355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 432/877] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:51 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:51.659999 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:51.668446 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:51.670182 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:51.671315 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-857514e6-4012-4ed9-9be6-866352c8a0ef tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.444378 Aug 04 16:29:51.671852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 446/878] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:51 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:29:52.629835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ded88d4d-91da-4b0e-9f98-01c50a6999d0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:52.630784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ded88d4d-91da-4b0e-9f98-01c50a6999d0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:52.638455 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded88d4d-91da-4b0e-9f98-01c50a6999d0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:52.638929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded88d4d-91da-4b0e-9f98-01c50a6999d0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:52.639709 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded88d4d-91da-4b0e-9f98-01c50a6999d0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:52.640127 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ded88d4d-91da-4b0e-9f98-01c50a6999d0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:52.690366 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:52.690990 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:52.697454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:52.697900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:52.698702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:52.699133 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:52.708288 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ded88d4d-91da-4b0e-9f98-01c50a6999d0 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 14 microversion: 2.1 time: 0.082252 Aug 04 16:29:52.709193 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 433/879] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:52 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:29:52.832007 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:52.840945 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:52.842709 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:52.843882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-08d56697-fe2c-41e5-8402-c0c9c73767ec tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.157394 Aug 04 16:29:52.844453 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 447/880] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:52 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:53.723237 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a34fdc19-262e-4d8a-9c58-5191a3d67d41 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:53.724890 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a34fdc19-262e-4d8a-9c58-5191a3d67d41 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:53.734972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a34fdc19-262e-4d8a-9c58-5191a3d67d41 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:53.735400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a34fdc19-262e-4d8a-9c58-5191a3d67d41 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:53.736205 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a34fdc19-262e-4d8a-9c58-5191a3d67d41 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:53.736641 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a34fdc19-262e-4d8a-9c58-5191a3d67d41 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:53.801504 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a34fdc19-262e-4d8a-9c58-5191a3d67d41 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 6520 microversion: 2.1 time: 0.085002 Aug 04 16:29:53.802247 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 434/881] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:53 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 6520 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:29:53.866572 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:53.867206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:53.876580 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:53.877230 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:53.878515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:53.879153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:54.009826 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:54.018454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:54.019944 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:54.021747 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d5964513-255f-4f07-a1ff-f63b3a80818a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.160935 Aug 04 16:29:54.022624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 448/882] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:53 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:54.813981 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-570ceed6-bef3-482a-a93d-e024c0d467fb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:54.815016 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-570ceed6-bef3-482a-a93d-e024c0d467fb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:54.822086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-570ceed6-bef3-482a-a93d-e024c0d467fb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:54.822561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-570ceed6-bef3-482a-a93d-e024c0d467fb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:54.823323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-570ceed6-bef3-482a-a93d-e024c0d467fb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:54.823751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-570ceed6-bef3-482a-a93d-e024c0d467fb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:54.887978 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-570ceed6-bef3-482a-a93d-e024c0d467fb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 15025 microversion: 2.1 time: 0.077900 Aug 04 16:29:54.888646 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 435/883] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:54 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 15025 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:29:55.043121 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:55.043792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:55.050877 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:55.051327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:55.052144 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:55.052582 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:55.185651 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:55.194633 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:55.196194 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:55.197354 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2d17cc59-4abf-4348-aae7-e01510bb482e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.158118 Aug 04 16:29:55.197935 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 449/884] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:55 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:55.904362 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-aa1209b2-5715-437f-86a0-756205a14434 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:55.906021 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-aa1209b2-5715-437f-86a0-756205a14434 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:55.916487 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa1209b2-5715-437f-86a0-756205a14434 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:55.917086 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa1209b2-5715-437f-86a0-756205a14434 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:55.918420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa1209b2-5715-437f-86a0-756205a14434 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:55.919088 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-aa1209b2-5715-437f-86a0-756205a14434 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:55.988339 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-aa1209b2-5715-437f-86a0-756205a14434 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 18356 microversion: 2.1 time: 0.090466 Aug 04 16:29:55.988976 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 436/885] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:55 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 18356 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:29:56.219260 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:56.219815 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:56.226510 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:56.226948 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:56.227750 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:56.228213 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:56.363646 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:56.372619 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:56.374155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:56.375332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6a7980d2-7335-4b0e-a33f-664a152dc9c0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.161271 Aug 04 16:29:56.375902 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 450/886] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:56 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:57.000419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-908f8bdc-d9cf-4519-bee9-feab137115c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:57.001454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-908f8bdc-d9cf-4519-bee9-feab137115c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:57.008244 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-908f8bdc-d9cf-4519-bee9-feab137115c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:57.008683 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-908f8bdc-d9cf-4519-bee9-feab137115c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:57.009442 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-908f8bdc-d9cf-4519-bee9-feab137115c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:57.009865 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-908f8bdc-d9cf-4519-bee9-feab137115c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:57.079476 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-908f8bdc-d9cf-4519-bee9-feab137115c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 19342 microversion: 2.1 time: 0.083017 Aug 04 16:29:57.080139 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 437/887] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:56 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 19342 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:29:57.393064 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:57.393670 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:57.400033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:57.400452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:57.401228 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:57.401658 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:57.537324 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:57.546111 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:57.547618 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:57.548787 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-948edb57-8180-484c-b7aa-6cd4fffffeac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.159735 Aug 04 16:29:57.549382 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 451/888] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:57 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:58.092444 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2e20031b-554b-4a84-8e00-000a8c82a8d2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:58.093495 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2e20031b-554b-4a84-8e00-000a8c82a8d2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:58.100617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e20031b-554b-4a84-8e00-000a8c82a8d2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:58.101068 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e20031b-554b-4a84-8e00-000a8c82a8d2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:58.101851 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e20031b-554b-4a84-8e00-000a8c82a8d2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:58.102326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2e20031b-554b-4a84-8e00-000a8c82a8d2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:58.167823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2e20031b-554b-4a84-8e00-000a8c82a8d2 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 22119 microversion: 2.1 time: 0.079797 Aug 04 16:29:58.168786 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 438/889] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:58 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 22119 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:29:58.571161 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:58.571947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:58.579363 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:58.579812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:58.580598 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:58.581028 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:58.723954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:58.733343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:58.735041 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:58.736210 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-193cf139-98e9-4b16-bf4e-1954269090f0 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.169151 Aug 04 16:29:58.736790 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 452/890] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:58 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:29:59.180489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6762b1f5-8370-440a-bef6-ab4fb2d3f4a8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:29:59.181487 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6762b1f5-8370-440a-bef6-ab4fb2d3f4a8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:59.188700 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6762b1f5-8370-440a-bef6-ab4fb2d3f4a8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:59.189136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6762b1f5-8370-440a-bef6-ab4fb2d3f4a8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:59.189937 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6762b1f5-8370-440a-bef6-ab4fb2d3f4a8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:59.190400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6762b1f5-8370-440a-bef6-ab4fb2d3f4a8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:59.259771 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6762b1f5-8370-440a-bef6-ab4fb2d3f4a8 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 23235 microversion: 2.1 time: 0.083197 Aug 04 16:29:59.260420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 439/891] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:29:59 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 23235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:29:59.754515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:29:59.755161 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:29:59.763332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:59.763809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:59.764590 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:29:59.765017 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:29:59.901599 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:59.910148 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:59.911636 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:29:59.912773 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3bde41cd-9dba-458b-93c5-815bd1caf16d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.162101 Aug 04 16:29:59.913385 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 453/892] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:29:59 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:00.276660 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3f7abbc5-7fcd-4b5d-939f-85c5e1e95d02 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:00.278355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3f7abbc5-7fcd-4b5d-939f-85c5e1e95d02 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:00.285398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f7abbc5-7fcd-4b5d-939f-85c5e1e95d02 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:00.285847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f7abbc5-7fcd-4b5d-939f-85c5e1e95d02 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:00.286651 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f7abbc5-7fcd-4b5d-939f-85c5e1e95d02 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:00.287078 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3f7abbc5-7fcd-4b5d-939f-85c5e1e95d02 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:00.355701 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3f7abbc5-7fcd-4b5d-939f-85c5e1e95d02 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 24778 microversion: 2.1 time: 0.085750 Aug 04 16:30:00.356396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 440/893] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:00 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 24778 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:00.931390 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:00.932106 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:00.938829 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:00.939271 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:00.940215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:00.940525 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:01.080791 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:01.089291 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:01.090828 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:01.092020 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f6f0be37-c96d-4ba0-aff6-01fe96e0c040 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.164544 Aug 04 16:30:01.092591 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 454/894] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:00 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:01.369359 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e3632eb5-07d0-425a-b3b5-573728c9364d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:01.370397 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e3632eb5-07d0-425a-b3b5-573728c9364d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:01.378403 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3632eb5-07d0-425a-b3b5-573728c9364d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:01.379392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3632eb5-07d0-425a-b3b5-573728c9364d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:01.379613 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3632eb5-07d0-425a-b3b5-573728c9364d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:01.380164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e3632eb5-07d0-425a-b3b5-573728c9364d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:01.449162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e3632eb5-07d0-425a-b3b5-573728c9364d tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 26263 microversion: 2.1 time: 0.083622 Aug 04 16:30:01.450105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 441/895] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:01 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 26263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:02.112139 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:02.112717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:02.119337 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:02.119789 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:02.120566 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:02.121004 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:02.259028 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:02.267450 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:02.268939 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:02.270121 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6020f5d1-c568-4113-9b1d-30717abec194 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1743 microversion: 2.20 time: 0.163166 Aug 04 16:30:02.270696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 455/896] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:02 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:02.462548 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-673f92e7-df89-45b3-a1ea-d702da3e5f00 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:02.463549 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-673f92e7-df89-45b3-a1ea-d702da3e5f00 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:02.470692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-673f92e7-df89-45b3-a1ea-d702da3e5f00 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:02.471131 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-673f92e7-df89-45b3-a1ea-d702da3e5f00 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:02.471909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-673f92e7-df89-45b3-a1ea-d702da3e5f00 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:02.472333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-673f92e7-df89-45b3-a1ea-d702da3e5f00 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:02.538216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-673f92e7-df89-45b3-a1ea-d702da3e5f00 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 27203 microversion: 2.1 time: 0.079648 Aug 04 16:30:02.538878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 442/897] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:02 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 27203 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:03.288739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:03.289442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:03.296887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:03.297336 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:03.298173 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:03.298598 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:03.436091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:03.444403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:03.445912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:03.447098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b93b053e-ae0e-496f-a529-73b025fb0e9e tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1743 microversion: 2.20 time: 0.162201 Aug 04 16:30:03.447691 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 456/898] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:03 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:03.550981 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-904b3519-a773-44cc-b078-926737f56fbd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:03.551873 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-904b3519-a773-44cc-b078-926737f56fbd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:03.558848 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-904b3519-a773-44cc-b078-926737f56fbd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:03.559289 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-904b3519-a773-44cc-b078-926737f56fbd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:03.560063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-904b3519-a773-44cc-b078-926737f56fbd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:03.560619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-904b3519-a773-44cc-b078-926737f56fbd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:03.629912 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-904b3519-a773-44cc-b078-926737f56fbd tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 27846 microversion: 2.1 time: 0.083169 Aug 04 16:30:03.630607 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 443/899] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:03 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 27846 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:04.466569 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:04.467187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:04.473535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:04.473982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:04.474766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:04.475192 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:04.605141 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:04.613513 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:04.615040 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:04.616193 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-68c4e871-a164-4c7f-b8d9-77615d9efc32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1743 microversion: 2.20 time: 0.153568 Aug 04 16:30:04.616764 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 457/900] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:04 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:04.642523 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ac073fea-f3a6-4057-895d-eefb15f0736f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:04.643543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ac073fea-f3a6-4057-895d-eefb15f0736f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:04.650342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ac073fea-f3a6-4057-895d-eefb15f0736f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:04.650789 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ac073fea-f3a6-4057-895d-eefb15f0736f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:04.651553 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ac073fea-f3a6-4057-895d-eefb15f0736f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:04.651981 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ac073fea-f3a6-4057-895d-eefb15f0736f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:04.722134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ac073fea-f3a6-4057-895d-eefb15f0736f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28063 microversion: 2.1 time: 0.083570 Aug 04 16:30:04.722804 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 444/901] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:04 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28063 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:05.637700 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:05.638981 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:05.646134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:05.647098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:05.648085 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:05.648734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:05.737855 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9f8f041e-c639-4d15-b2d0-856e7c2750ae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:05.739108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9f8f041e-c639-4d15-b2d0-856e7c2750ae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:05.745940 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9f8f041e-c639-4d15-b2d0-856e7c2750ae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:05.746561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9f8f041e-c639-4d15-b2d0-856e7c2750ae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:05.747937 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9f8f041e-c639-4d15-b2d0-856e7c2750ae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:05.748496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9f8f041e-c639-4d15-b2d0-856e7c2750ae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:05.827854 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:05.839741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9f8f041e-c639-4d15-b2d0-856e7c2750ae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28202 microversion: 2.1 time: 0.107767 Aug 04 16:30:05.842499 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 445/902] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:05 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28202 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:05.845933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:05.847995 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:05.849442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-aba66ff4-b6da-4e3f-ba6a-81989a9b4be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.217710 Aug 04 16:30:05.860980 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 458/903] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:05 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:06.855265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ebbf1a66-4577-4b88-920d-475197159452 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:06.856875 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ebbf1a66-4577-4b88-920d-475197159452 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:06.868326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ebbf1a66-4577-4b88-920d-475197159452 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:06.868972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ebbf1a66-4577-4b88-920d-475197159452 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:06.870038 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:06.870538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ebbf1a66-4577-4b88-920d-475197159452 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:06.870840 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ebbf1a66-4577-4b88-920d-475197159452 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:06.871592 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:06.879208 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:06.880003 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:06.881040 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:06.881778 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:06.964589 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ebbf1a66-4577-4b88-920d-475197159452 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28202 microversion: 2.1 time: 0.115973 Aug 04 16:30:06.965258 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 446/904] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:06 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:07.026034 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:07.036524 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:07.037635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:07.038892 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c725d6a9-3987-4e2c-b4c8-0f1b672cbb98 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.174254 Aug 04 16:30:07.039693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 459/905] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:06 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:07.639123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-619372d5-6f66-4b01-9ec4-243821fcd6ce req-ad93b744-1952-4e66-8524-5460c16b19e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dceabbf2-ecd4-497b-997a-1acbda49ddf9", "name": "network-vif-plugged", "status": "completed", "tag": "17e1d80b-51b6-4b09-b512-e218dc6eaeaa"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:07.641055 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:30:07.641055 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:30:07.649643 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-619372d5-6f66-4b01-9ec4-243821fcd6ce req-ad93b744-1952-4e66-8524-5460c16b19e9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:07.650153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-619372d5-6f66-4b01-9ec4-243821fcd6ce req-ad93b744-1952-4e66-8524-5460c16b19e9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:07.662818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-619372d5-6f66-4b01-9ec4-243821fcd6ce req-ad93b744-1952-4e66-8524-5460c16b19e9 service nova] Creating event network-vif-plugged:17e1d80b-51b6-4b09-b512-e218dc6eaeaa for instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 on hv-cinder-78956 Aug 04 16:30:07.673320 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-619372d5-6f66-4b01-9ec4-243821fcd6ce req-ad93b744-1952-4e66-8524-5460c16b19e9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038486 Aug 04 16:30:07.674675 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 447/906] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:30:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:07.976865 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c8a6ba54-cb2c-488f-8dcf-b5a2251794bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:07.978782 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c8a6ba54-cb2c-488f-8dcf-b5a2251794bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:07.985872 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c8a6ba54-cb2c-488f-8dcf-b5a2251794bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:07.986464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c8a6ba54-cb2c-488f-8dcf-b5a2251794bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:07.987366 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c8a6ba54-cb2c-488f-8dcf-b5a2251794bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:07.987903 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c8a6ba54-cb2c-488f-8dcf-b5a2251794bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:08.058742 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:08.060580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:08.064044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c8a6ba54-cb2c-488f-8dcf-b5a2251794bb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28202 microversion: 2.1 time: 0.090677 Aug 04 16:30:08.064937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 460/907] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:07 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:08.067784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:08.068310 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:08.069190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:08.069679 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:08.222960 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:08.232450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:08.234099 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:08.235288 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fad3f954-aa4e-4270-8ca4-5ecc1de76e4a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.180725 Aug 04 16:30:08.235867 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 448/908] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:08 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:09.078282 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-bfc59daf-ecf3-4037-b1d7-c04b61253ed1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:09.079391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-bfc59daf-ecf3-4037-b1d7-c04b61253ed1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:09.086224 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bfc59daf-ecf3-4037-b1d7-c04b61253ed1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:09.087093 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bfc59daf-ecf3-4037-b1d7-c04b61253ed1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:09.087893 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bfc59daf-ecf3-4037-b1d7-c04b61253ed1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:09.088438 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-bfc59daf-ecf3-4037-b1d7-c04b61253ed1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:09.166045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-bfc59daf-ecf3-4037-b1d7-c04b61253ed1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28493 microversion: 2.1 time: 0.092566 Aug 04 16:30:09.169152 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 461/909] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:09 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28493 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:09.255222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:09.256753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:09.264487 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:09.265333 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:09.266363 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:09.267010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:09.418963 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:09.428567 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:09.430248 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:09.431434 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5898a40b-5c2e-4534-bea5-9ee057c6cb45 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.180496 Aug 04 16:30:09.438673 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 449/910] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:09 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:10.179968 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a9ccd5f6-4dc1-420f-b39a-522a3313d07f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:10.181673 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a9ccd5f6-4dc1-420f-b39a-522a3313d07f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:10.189216 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9ccd5f6-4dc1-420f-b39a-522a3313d07f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:10.189699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9ccd5f6-4dc1-420f-b39a-522a3313d07f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:10.190500 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9ccd5f6-4dc1-420f-b39a-522a3313d07f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:10.191152 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a9ccd5f6-4dc1-420f-b39a-522a3313d07f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:10.262316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a9ccd5f6-4dc1-420f-b39a-522a3313d07f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28661 microversion: 2.1 time: 0.086133 Aug 04 16:30:10.267480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 462/911] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:10 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:10.450738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:10.451915 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:10.463819 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:10.464241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:10.465078 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:10.465506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:10.605624 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:10.614805 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:10.616568 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:10.617933 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-779e4d5b-5884-48e1-8cfe-c44026786a6d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.171006 Aug 04 16:30:10.629438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 450/912] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:10 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:11.281043 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ee2a2944-2b12-46ef-be0e-e7c84d977435 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:11.282090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ee2a2944-2b12-46ef-be0e-e7c84d977435 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:11.291900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee2a2944-2b12-46ef-be0e-e7c84d977435 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:11.293544 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee2a2944-2b12-46ef-be0e-e7c84d977435 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:11.295365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee2a2944-2b12-46ef-be0e-e7c84d977435 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:11.295867 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee2a2944-2b12-46ef-be0e-e7c84d977435 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:11.382800 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ee2a2944-2b12-46ef-be0e-e7c84d977435 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28661 microversion: 2.1 time: 0.107864 Aug 04 16:30:11.383482 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 463/913] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:11 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:11.645244 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:11.645892 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:11.664342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:11.664774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:11.667227 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:11.667856 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:11.826202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:11.835750 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:11.838759 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:11.840118 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5ebb7528-0b14-4209-922e-e3cbd6d5a241 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.207298 Aug 04 16:30:11.846319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 451/914] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:11 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:12.395417 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-25b09ae2-8629-4e70-a05b-b16159264443 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:12.396562 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-25b09ae2-8629-4e70-a05b-b16159264443 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:12.404240 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-25b09ae2-8629-4e70-a05b-b16159264443 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:12.404658 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-25b09ae2-8629-4e70-a05b-b16159264443 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:12.405384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-25b09ae2-8629-4e70-a05b-b16159264443 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:12.405886 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-25b09ae2-8629-4e70-a05b-b16159264443 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:12.485983 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-25b09ae2-8629-4e70-a05b-b16159264443 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28661 microversion: 2.1 time: 0.094454 Aug 04 16:30:12.490993 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 464/915] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:12 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:12.859125 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:12.860918 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:12.867833 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:12.868617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:12.870021 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:12.870838 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:13.010189 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:13.031016 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:13.035732 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:13.038281 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d0e20b3e-9d1c-414d-b3d0-7b3e0d05140c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.182890 Aug 04 16:30:13.039544 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 452/916] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:12 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:13.504376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-82e82901-fcf4-4003-9e48-c02839ad5d94 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:13.506048 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-82e82901-fcf4-4003-9e48-c02839ad5d94 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:13.519283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e82901-fcf4-4003-9e48-c02839ad5d94 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:13.519986 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e82901-fcf4-4003-9e48-c02839ad5d94 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:13.521686 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e82901-fcf4-4003-9e48-c02839ad5d94 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:13.522811 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e82901-fcf4-4003-9e48-c02839ad5d94 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:13.629217 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-82e82901-fcf4-4003-9e48-c02839ad5d94 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 28661 microversion: 2.1 time: 0.133394 Aug 04 16:30:13.636911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 465/917] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:13 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 28661 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:14.064730 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:14.065356 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:14.071353 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:14.072043 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:14.072999 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:14.073579 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:14.257431 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:14.266152 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:14.267661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:14.268826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f6f388c9-b67f-40c6-baae-c0ad11537a39 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1738 microversion: 2.20 time: 0.209258 Aug 04 16:30:14.273764 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 453/918] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:14 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:14.644654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cc57949e-3c15-4ba9-9542-71d52f9ef75e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:14.645900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cc57949e-3c15-4ba9-9542-71d52f9ef75e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:14.653379 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc57949e-3c15-4ba9-9542-71d52f9ef75e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:14.653844 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc57949e-3c15-4ba9-9542-71d52f9ef75e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:14.654674 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc57949e-3c15-4ba9-9542-71d52f9ef75e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:14.655191 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cc57949e-3c15-4ba9-9542-71d52f9ef75e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:14.738475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cc57949e-3c15-4ba9-9542-71d52f9ef75e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 29640 microversion: 2.1 time: 0.097798 Aug 04 16:30:14.739491 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 466/919] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:14 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 29640 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:15.287475 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:15.288089 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:15.294856 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:15.295426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:15.296204 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:15.296626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:15.461655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:15.470524 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:15.472023 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:15.473185 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fdc8963f-c38d-408c-bc04-18ff4e9e63c1 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1720 microversion: 2.20 time: 0.189805 Aug 04 16:30:15.473778 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 454/920] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:15 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:15.751660 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2b059240-e8f8-4259-a97a-c5a7e3f443be tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:15.752670 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2b059240-e8f8-4259-a97a-c5a7e3f443be tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:15.762866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2b059240-e8f8-4259-a97a-c5a7e3f443be tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:15.763318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2b059240-e8f8-4259-a97a-c5a7e3f443be tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:15.764396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2b059240-e8f8-4259-a97a-c5a7e3f443be tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:15.764810 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2b059240-e8f8-4259-a97a-c5a7e3f443be tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:15.832254 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2b059240-e8f8-4259-a97a-c5a7e3f443be tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 31344 microversion: 2.1 time: 0.084481 Aug 04 16:30:15.832809 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 467/921] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:15 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 31344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:16.493606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:16.494223 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:16.501007 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:16.501437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:16.502228 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:16.502647 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:16.645067 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:16.653208 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:16.654755 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:16.655923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d8099f83-49c7-49e2-af59-8640bcedfef6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1720 microversion: 2.20 time: 0.166671 Aug 04 16:30:16.656499 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 455/922] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:16 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:16.847160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a0ef2fb5-9bae-4244-8f01-20f880c82c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:16.848426 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a0ef2fb5-9bae-4244-8f01-20f880c82c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:16.856871 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a0ef2fb5-9bae-4244-8f01-20f880c82c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:16.857354 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a0ef2fb5-9bae-4244-8f01-20f880c82c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:16.858173 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a0ef2fb5-9bae-4244-8f01-20f880c82c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:16.858597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a0ef2fb5-9bae-4244-8f01-20f880c82c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:16.931911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a0ef2fb5-9bae-4244-8f01-20f880c82c4a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 32673 microversion: 2.1 time: 0.089593 Aug 04 16:30:16.932498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 468/923] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:16 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 32673 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:17.679648 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:17.680257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:17.686712 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:17.687184 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:17.687935 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:17.688373 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:17.827914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:17.836897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:17.838448 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:17.839668 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-adcaa3c7-0d30-4d8b-a1d2-76aed1751df9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1720 microversion: 2.20 time: 0.163891 Aug 04 16:30:17.840264 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 456/924] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:17 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:17.945027 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1f7310cd-2eac-4447-a4ac-908b65765260 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:17.946093 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1f7310cd-2eac-4447-a4ac-908b65765260 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:17.954971 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f7310cd-2eac-4447-a4ac-908b65765260 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:17.955415 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f7310cd-2eac-4447-a4ac-908b65765260 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:17.959691 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f7310cd-2eac-4447-a4ac-908b65765260 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:17.960184 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1f7310cd-2eac-4447-a4ac-908b65765260 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:18.030644 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1f7310cd-2eac-4447-a4ac-908b65765260 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 33486 microversion: 2.1 time: 0.089600 Aug 04 16:30:18.034861 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 469/925] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:17 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 33486 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:18.864854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:18.865729 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:18.874708 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:18.875220 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:18.876021 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:18.876457 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.006009 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:19.014863 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:19.016355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:19.017496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-df3b697b-aaa9-4bea-bab0-a11a624dd0bf tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1663 microversion: 2.20 time: 0.160023 Aug 04 16:30:19.018090 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 457/926] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:18 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:19.035908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d106369b-713d-48cf-a7d8-d4ff2923da21 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc834fe5-8ef6-4c24-a482-a63f57a68720"}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:19.037076 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d106369b-713d-48cf-a7d8-d4ff2923da21 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:19.042265 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-664538ea-5d2d-4c5c-82d7-32be94ad6222 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:19.043241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-664538ea-5d2d-4c5c-82d7-32be94ad6222 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:19.044656 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d106369b-713d-48cf-a7d8-d4ff2923da21 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.045405 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d106369b-713d-48cf-a7d8-d4ff2923da21 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.046833 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d106369b-713d-48cf-a7d8-d4ff2923da21 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.047560 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d106369b-713d-48cf-a7d8-d4ff2923da21 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.049818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-664538ea-5d2d-4c5c-82d7-32be94ad6222 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.050312 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-664538ea-5d2d-4c5c-82d7-32be94ad6222 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.051134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-664538ea-5d2d-4c5c-82d7-32be94ad6222 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.051731 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-664538ea-5d2d-4c5c-82d7-32be94ad6222 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.125355 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-664538ea-5d2d-4c5c-82d7-32be94ad6222 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 34231 microversion: 2.1 time: 0.086310 Aug 04 16:30:19.126009 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 458/927] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:19 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 34231 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:19.353984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d106369b-713d-48cf-a7d8-d4ff2923da21 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322320 Aug 04 16:30:19.354898 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 470/928] 10.222.0.77 () {62 vars in 1364 bytes} [Wed Aug 4 16:30:19 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:19.428077 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8b056105-4ed5-4c28-a5ce-3fb3a8c76b31 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:19.428650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8b056105-4ed5-4c28-a5ce-3fb3a8c76b31 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:19.435469 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8b056105-4ed5-4c28-a5ce-3fb3a8c76b31 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.436029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8b056105-4ed5-4c28-a5ce-3fb3a8c76b31 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.436837 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8b056105-4ed5-4c28-a5ce-3fb3a8c76b31 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.437264 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8b056105-4ed5-4c28-a5ce-3fb3a8c76b31 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.604206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-75c2a4bb-a6f6-454c-945f-9fc1a6d529da req-daa78788-e3fa-4435-9382-7e844ea5030d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dceabbf2-ecd4-497b-997a-1acbda49ddf9", "name": "network-vif-unplugged", "status": "completed", "tag": "17e1d80b-51b6-4b09-b512-e218dc6eaeaa"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:19.605696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:30:19.605696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:30:19.614281 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-75c2a4bb-a6f6-454c-945f-9fc1a6d529da req-daa78788-e3fa-4435-9382-7e844ea5030d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.614971 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-75c2a4bb-a6f6-454c-945f-9fc1a6d529da req-daa78788-e3fa-4435-9382-7e844ea5030d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.627163 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.compute.server_external_events [req-75c2a4bb-a6f6-454c-945f-9fc1a6d529da req-daa78788-e3fa-4435-9382-7e844ea5030d service nova] Unable to find a host for instance dceabbf2-ecd4-497b-997a-1acbda49ddf9. Dropping event network-vif-unplugged {{(pid=107559) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 04 16:30:19.628268 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-75c2a4bb-a6f6-454c-945f-9fc1a6d529da req-daa78788-e3fa-4435-9382-7e844ea5030d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031013 Aug 04 16:30:19.628956 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 471/929] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 16:30:19.745640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8b056105-4ed5-4c28-a5ce-3fb3a8c76b31 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/os-volume_attachments/cc834fe5-8ef6-4c24-a482-a63f57a68720" status: 202 len: 0 microversion: 2.20 time: 0.320132 Aug 04 16:30:19.747002 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 459/930] 10.222.0.77 () {60 vars in 1457 bytes} [Wed Aug 4 16:30:19 2021] DELETE /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/os-volume_attachments/cc834fe5-8ef6-4c24-a482-a63f57a68720 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:30:19.812328 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-44250430-8a53-4b08-a500-aa826b5748ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:19.812901 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-44250430-8a53-4b08-a500-aa826b5748ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:19.820458 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-44250430-8a53-4b08-a500-aa826b5748ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.820919 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-44250430-8a53-4b08-a500-aa826b5748ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.821700 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-44250430-8a53-4b08-a500-aa826b5748ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.822158 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-44250430-8a53-4b08-a500-aa826b5748ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.907676 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-44250430-8a53-4b08-a500-aa826b5748ac tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action" status: 202 len: 0 microversion: 2.20 time: 0.100287 Aug 04 16:30:19.908236 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 472/931] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 4 16:30:19 2021] POST /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:30:19.916222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:19.917419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:19.924096 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.924543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:19.925305 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:19.925733 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:20.059664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:20.067630 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:20.069136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:20.070308 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2b8501fd-a17e-4b5b-89ea-12bbcd4c2584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1671 microversion: 2.20 time: 0.157891 Aug 04 16:30:20.070860 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 460/932] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:19 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:20.137627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c1fd564b-0e2c-4326-966c-564acc948a89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:20.140488 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c1fd564b-0e2c-4326-966c-564acc948a89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:20.147072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1fd564b-0e2c-4326-966c-564acc948a89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:20.147519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1fd564b-0e2c-4326-966c-564acc948a89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:20.148299 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1fd564b-0e2c-4326-966c-564acc948a89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:20.148753 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c1fd564b-0e2c-4326-966c-564acc948a89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:20.218653 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c1fd564b-0e2c-4326-966c-564acc948a89 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 35303 microversion: 2.1 time: 0.085272 Aug 04 16:30:20.219308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 473/933] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:20 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 35303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:30:21.088827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:21.089464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:21.096074 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:21.096519 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:21.097288 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:21.097717 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:21.230629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b852e089-1049-4821-91d3-66ffd3e3c856 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:21.231645 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b852e089-1049-4821-91d3-66ffd3e3c856 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:21.236391 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:21.244775 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:21.246303 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:21.246832 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b852e089-1049-4821-91d3-66ffd3e3c856 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:21.247283 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b852e089-1049-4821-91d3-66ffd3e3c856 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:21.247468 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-56d2647f-63e8-4d6d-8489-362a83285ddc tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.162506 Aug 04 16:30:21.248049 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 461/934] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:21 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:21.248160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b852e089-1049-4821-91d3-66ffd3e3c856 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:21.248878 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b852e089-1049-4821-91d3-66ffd3e3c856 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:21.328563 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b852e089-1049-4821-91d3-66ffd3e3c856 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 36677 microversion: 2.1 time: 0.101864 Aug 04 16:30:21.329790 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 474/935] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:21 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 36677 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:30:22.266815 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:22.267390 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:22.273891 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:22.274479 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:22.275191 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:22.275609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:22.344193 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5e6ce979-3ae3-40cc-bee2-422e4f2328e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:22.350384 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5e6ce979-3ae3-40cc-bee2-422e4f2328e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:22.357722 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e6ce979-3ae3-40cc-bee2-422e4f2328e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:22.358909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e6ce979-3ae3-40cc-bee2-422e4f2328e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:22.359837 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e6ce979-3ae3-40cc-bee2-422e4f2328e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:22.360337 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5e6ce979-3ae3-40cc-bee2-422e4f2328e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:22.538620 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:22.558304 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:22.560354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:22.561921 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c6b06985-2c88-4a80-90c1-4631ff30c64a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.299316 Aug 04 16:30:22.573240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 462/936] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:22 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:23.582709 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:23.585342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:23.592592 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:23.593605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:23.594766 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:23.595515 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:23.781175 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:23.792120 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:23.793642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:23.794882 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ff272abd-6962-45dd-9bd7-1a402ee20d96 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.218126 Aug 04 16:30:23.796292 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 463/937] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:23 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:24.814567 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:24.815266 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:24.822149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:24.822606 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:24.823396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:24.823827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:24.966248 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:24.975252 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:24.977043 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:24.978283 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-437f2125-065d-41bf-bd0f-094dd1bc7479 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.167676 Aug 04 16:30:24.980594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 464/938] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:24 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:26.002771 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:26.004896 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:26.014886 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:26.015522 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:26.016520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:26.017093 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:26.156327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:26.166725 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:26.168218 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:26.169457 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f294599f-3a39-43f1-9093-118a84afb82b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.173741 Aug 04 16:30:26.170056 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 465/939] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:25 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:27.190138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:27.190839 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:27.197331 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:27.197780 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:27.198599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:27.199027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:27.342953 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:27.352038 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:27.353554 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:27.364687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-460a637e-91a8-454f-b40f-867a3291bff6 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.176355 Aug 04 16:30:27.364687 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 466/940] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:27 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:28.386458 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:28.387451 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:28.394664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:28.395147 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:28.395885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:28.396313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:28.553902 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:28.563021 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:28.564563 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:28.565810 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8fd98bb6-14ce-45ef-8ba4-977a884a7a32 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.183277 Aug 04 16:30:28.566429 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 467/941] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:28 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:29.586024 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:29.586973 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:29.593540 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:29.594474 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:29.595008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:29.595454 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:29.760460 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:29.769597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:29.771190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:29.772375 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-eed360c6-75ce-4d97-96e4-5e56110abdc9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.190283 Aug 04 16:30:29.783960 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 468/942] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:29 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:30.801283 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:30.802423 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:30.810743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:30.811377 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:30.812286 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:30.812784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:30.961233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:30.972428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:30.974118 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:30.975348 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-811eb1ad-f732-416b-b235-1800ee036584 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.177966 Aug 04 16:30:30.976085 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 469/943] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:30 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:31.993012 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:31.994132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:32.000416 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:32.000864 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:32.001640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:32.002105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:32.156671 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:32.165494 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:32.167006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:32.168164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-97dd7140-4b91-43c0-b707-ef41d259fba5 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.179017 Aug 04 16:30:32.168720 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 470/944] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:31 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:30:32.739531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5e6ce979-3ae3-40cc-bee2-422e4f2328e5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action" status: 200 len: 38317 microversion: 2.1 time: 10.401739 Aug 04 16:30:32.740205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 475/945] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:30:22 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/action => generated 38317 bytes in 10404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:30:32.751327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-52602ce8-ada9-45cd-afc1-b35439680e92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:32.751818 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-52602ce8-ada9-45cd-afc1-b35439680e92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:32.758316 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52602ce8-ada9-45cd-afc1-b35439680e92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:32.758769 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52602ce8-ada9-45cd-afc1-b35439680e92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:32.759546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52602ce8-ada9-45cd-afc1-b35439680e92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:32.759983 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-52602ce8-ada9-45cd-afc1-b35439680e92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:32.788284 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-52602ce8-ada9-45cd-afc1-b35439680e92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/ips" status: 200 len: 144 microversion: 2.1 time: 0.041398 Aug 04 16:30:32.788756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 471/946] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 4 16:30:32 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:33.187535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:33.188359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:33.195690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:33.196146 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:33.196945 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:33.197376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:33.339538 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:33.348272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:33.349775 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:33.350947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-14ea0c41-fae2-441f-92b9-1804640f51a3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.167913 Aug 04 16:30:33.351515 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 476/947] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:33 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:34.171982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-645c328e-9f2b-4dbb-8441-8ce543db5614 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1583c75-6f65-49a0-b941-93e83731f8a3"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:34.173025 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-645c328e-9f2b-4dbb-8441-8ce543db5614 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:34.179255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-645c328e-9f2b-4dbb-8441-8ce543db5614 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:34.179690 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-645c328e-9f2b-4dbb-8441-8ce543db5614 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:34.180451 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-645c328e-9f2b-4dbb-8441-8ce543db5614 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:34.180872 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-645c328e-9f2b-4dbb-8441-8ce543db5614 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:34.369859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:34.370475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:34.380033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:34.380882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:34.382122 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:34.382567 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:34.481322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-645c328e-9f2b-4dbb-8441-8ce543db5614 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313184 Aug 04 16:30:34.482073 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 472/948] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:30:34 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:34.544633 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:34.554499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:34.555799 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:34.557909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f28eeca2-6172-41c1-85d4-964b1bf95b97 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.191980 Aug 04 16:30:34.558518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 477/949] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:34 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:35.577580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:35.577580 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:35.586300 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:35.587272 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:35.587843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:35.587843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:35.749767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:35.758921 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:35.761419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:35.763380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-137b71b5-1124-4c4e-807a-fd645cf4bd05 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.190263 Aug 04 16:30:35.764583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 473/950] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:35 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:36.781792 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:36.782442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:36.789422 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:36.789871 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:36.790690 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:36.791121 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:36.916612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:36.925228 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:36.926774 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:36.927941 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ec6a0d0b-73c4-49ac-ba42-9c638ed4d6d3 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.150043 Aug 04 16:30:36.928530 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 478/951] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:36 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:37.729030 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-568064dd-9f09-4470-b779-540847a5c46e req-f3501729-af24-47b7-9a9b-ed5a535af60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dceabbf2-ecd4-497b-997a-1acbda49ddf9", "name": "network-vif-plugged", "status": "completed", "tag": "17e1d80b-51b6-4b09-b512-e218dc6eaeaa"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:37.730644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:30:37.730644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:30:37.740166 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-568064dd-9f09-4470-b779-540847a5c46e req-f3501729-af24-47b7-9a9b-ed5a535af60b service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:37.740166 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-568064dd-9f09-4470-b779-540847a5c46e req-f3501729-af24-47b7-9a9b-ed5a535af60b service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:37.760156 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-568064dd-9f09-4470-b779-540847a5c46e req-f3501729-af24-47b7-9a9b-ed5a535af60b service nova] Creating event network-vif-plugged:17e1d80b-51b6-4b09-b512-e218dc6eaeaa for instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 on hv-cinder-78956 Aug 04 16:30:37.765668 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-568064dd-9f09-4470-b779-540847a5c46e req-f3501729-af24-47b7-9a9b-ed5a535af60b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040226 Aug 04 16:30:37.766326 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 474/952] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:30:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:37.958519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:37.959433 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:37.967879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:37.969046 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:37.970834 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:37.971340 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:38.134232 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:38.151134 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:38.153031 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:38.154779 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3f7829ad-aa3d-42f1-ad18-1d3641b04a7b tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.201409 Aug 04 16:30:38.155693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 479/953] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:37 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:39.176307 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:39.177040 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:39.185718 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:39.186564 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:39.187350 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:39.187790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:39.368830 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:39.377531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:39.379004 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:39.380201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-328494c7-f930-4125-9b0e-df7369af48ff tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1729 microversion: 2.20 time: 0.209722 Aug 04 16:30:39.380759 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 475/954] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:39 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:40.398983 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:40.399558 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:40.409533 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:40.410023 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:40.410759 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:40.411201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:40.586906 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:40.595535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:40.597039 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:30:40.598352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-768d439f-1b52-4db3-8745-435181a20488 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1716 microversion: 2.20 time: 0.203088 Aug 04 16:30:40.598947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 480/955] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:30:40 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1716 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:40.963593 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f032c61b-f3f2-4eda-b9bd-db146d4c0812 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:40.965530 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f032c61b-f3f2-4eda-b9bd-db146d4c0812 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:40.972383 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f032c61b-f3f2-4eda-b9bd-db146d4c0812 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:40.972989 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f032c61b-f3f2-4eda-b9bd-db146d4c0812 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:40.974202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f032c61b-f3f2-4eda-b9bd-db146d4c0812 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:40.974776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f032c61b-f3f2-4eda-b9bd-db146d4c0812 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:41.007060 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f032c61b-f3f2-4eda-b9bd-db146d4c0812 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Aug 04 16:30:41.007640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 476/956] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 4 16:30:40 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:41.017793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-cbdd9bca-f304-49e3-9713-97110d4bbab5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:41.018304 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-cbdd9bca-f304-49e3-9713-97110d4bbab5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:41.024980 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbdd9bca-f304-49e3-9713-97110d4bbab5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:41.025424 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbdd9bca-f304-49e3-9713-97110d4bbab5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:41.026256 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbdd9bca-f304-49e3-9713-97110d4bbab5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:41.026834 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-cbdd9bca-f304-49e3-9713-97110d4bbab5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:41.057184 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-cbdd9bca-f304-49e3-9713-97110d4bbab5 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/d1583c75-6f65-49a0-b941-93e83731f8a3" status: 200 len: 194 microversion: 2.1 time: 0.043505 Aug 04 16:30:41.057790 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 481/957] 10.222.0.77 () {58 vars in 1413 bytes} [Wed Aug 4 16:30:41 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/d1583c75-6f65-49a0-b941-93e83731f8a3 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:42.423753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fd5b0788-16ec-4f5e-b51d-c2e018f0124e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb221bd2-3913-4d21-85bd-bf517d62c2bc"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:30:42.425051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fd5b0788-16ec-4f5e-b51d-c2e018f0124e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:42.436635 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd5b0788-16ec-4f5e-b51d-c2e018f0124e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:42.437388 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd5b0788-16ec-4f5e-b51d-c2e018f0124e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:42.438883 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd5b0788-16ec-4f5e-b51d-c2e018f0124e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:42.439608 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fd5b0788-16ec-4f5e-b51d-c2e018f0124e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:42.713407 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fd5b0788-16ec-4f5e-b51d-c2e018f0124e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294064 Aug 04 16:30:42.714115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 477/958] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:30:42 2021] POST /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:50.220035 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-287b276c-a0fe-4c7d-81a0-a59834acc1eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:50.220961 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-287b276c-a0fe-4c7d-81a0-a59834acc1eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:30:50.227477 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-287b276c-a0fe-4c7d-81a0-a59834acc1eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:50.227947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-287b276c-a0fe-4c7d-81a0-a59834acc1eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:50.228701 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-287b276c-a0fe-4c7d-81a0-a59834acc1eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:30:50.229125 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-287b276c-a0fe-4c7d-81a0-a59834acc1eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:30:50.261520 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-287b276c-a0fe-4c7d-81a0-a59834acc1eb tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045844 Aug 04 16:30:50.262113 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 482/959] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 4 16:30:50 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:06.008216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2efa2631-fd07-4bb9-b800-c63713aa5e7a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:06.008907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2efa2631-fd07-4bb9-b800-c63713aa5e7a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:06.015910 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2efa2631-fd07-4bb9-b800-c63713aa5e7a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:06.016354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2efa2631-fd07-4bb9-b800-c63713aa5e7a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:06.017131 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2efa2631-fd07-4bb9-b800-c63713aa5e7a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:06.017559 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2efa2631-fd07-4bb9-b800-c63713aa5e7a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:06.047728 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2efa2631-fd07-4bb9-b800-c63713aa5e7a tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/d1583c75-6f65-49a0-b941-93e83731f8a3" status: 200 len: 194 microversion: 2.1 time: 0.044482 Aug 04 16:31:06.048339 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 478/960] 10.222.0.77 () {58 vars in 1413 bytes} [Wed Aug 4 16:31:06 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/d1583c75-6f65-49a0-b941-93e83731f8a3 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:06.058713 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:06.059332 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:06.067058 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:06.067496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:06.068265 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:06.068688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:06.157019 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lazy-loading 'services' on Instance uuid 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:31:06.227676 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b57eb3ea-49a7-443e-a2e7-e13489663173 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/d1583c75-6f65-49a0-b941-93e83731f8a3" status: 202 len: 0 microversion: 2.1 time: 0.172901 Aug 04 16:31:06.228241 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 483/961] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:31:06 2021] DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/d1583c75-6f65-49a0-b941-93e83731f8a3 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:31:07.367280 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-adeed928-4586-4a34-8299-8a8f0b59ed75 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:07.367885 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-adeed928-4586-4a34-8299-8a8f0b59ed75 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:07.374708 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adeed928-4586-4a34-8299-8a8f0b59ed75 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:07.375153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adeed928-4586-4a34-8299-8a8f0b59ed75 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:07.375943 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adeed928-4586-4a34-8299-8a8f0b59ed75 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:07.376376 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-adeed928-4586-4a34-8299-8a8f0b59ed75 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:07.413374 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-adeed928-4586-4a34-8299-8a8f0b59ed75 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/bb221bd2-3913-4d21-85bd-bf517d62c2bc" status: 200 len: 194 microversion: 2.1 time: 0.050005 Aug 04 16:31:07.413982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 479/962] 10.222.0.77 () {58 vars in 1413 bytes} [Wed Aug 4 16:31:07 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/bb221bd2-3913-4d21-85bd-bf517d62c2bc => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:07.426555 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:07.427161 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:07.436893 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:07.437338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:07.438156 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:07.438623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:07.526634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lazy-loading 'services' on Instance uuid 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:31:07.593588 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5778587a-a9fa-4a36-b3d0-9327abf9b9c3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/bb221bd2-3913-4d21-85bd-bf517d62c2bc" status: 202 len: 0 microversion: 2.1 time: 0.172756 Aug 04 16:31:07.594213 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 484/963] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:31:07 2021] DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b/os-volume_attachments/bb221bd2-3913-4d21-85bd-bf517d62c2bc => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:31:08.944174 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:08.944736 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:08.952587 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:08.953034 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:08.953824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:08.954380 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:08.981152 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:31:09.073058 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ad013de0-a12a-4bc4-8529-b3bad7b4ad97 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 204 len: 0 microversion: 2.1 time: 0.132340 Aug 04 16:31:09.073672 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 480/964] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:31:08 2021] DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:31:09.083302 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:09.083994 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:09.090430 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:09.090881 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:09.091692 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:09.092120 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:09.219346 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:09.228494 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0d616b83-38c3-43b2-adc4-f9d0a29fd19e tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1671 microversion: 2.1 time: 0.149299 Aug 04 16:31:09.229094 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 485/965] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:09 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:10.246895 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:10.247621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:10.254377 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:10.254820 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:10.255583 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:10.256008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:10.391569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:10.399447 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-88a87e13-3750-4eaf-9bf1-61050b9f97f1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1671 microversion: 2.1 time: 0.156628 Aug 04 16:31:10.400016 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 481/966] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:10 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:11.419547 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:11.420327 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:11.427248 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:11.427677 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:11.428536 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:11.429036 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:11.567780 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:11.575875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7b77e774-27a9-4c36-a46e-bcbe39aaaa92 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1671 microversion: 2.1 time: 0.160557 Aug 04 16:31:11.576552 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 486/967] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:11 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:11.744732 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:31:11.748028 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:11.762233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:11.762685 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:11.763701 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:11.764408 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:11.789192 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.objects.instance [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lazy-loading 'flavor' on Instance uuid 30cc5de9-b97f-4969-b926-672feb3d04e4 {{(pid=107558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:31:11.868433 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c96b9492-5b24-41fe-9ea4-47bac0a6646e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "POST /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4/action" status: 202 len: 0 microversion: 2.1 time: 0.127318 Aug 04 16:31:11.869045 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 482/968] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:31:11 2021] POST /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:31:11.877394 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:11.878006 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:11.884111 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:11.884526 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:11.885589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:11.886150 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:12.023551 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:12.032304 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-1ed07188-c2a1-4f06-997b-6fea959a16d5 req-152d0dbb-1d48-459a-80d4-9cfb0f44c6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b", "name": "network-vif-deleted", "tag": "861bc984-e35a-4369-9f94-3889ac7bd84c"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:31:12.033247 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-46541e34-e790-4c8d-a052-227906caf9df tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.159415 Aug 04 16:31:12.033994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:31:12.033994 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:31:12.038608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 487/969] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:11 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:12.043010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-1ed07188-c2a1-4f06-997b-6fea959a16d5 req-152d0dbb-1d48-459a-80d4-9cfb0f44c6c8 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:12.043373 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-1ed07188-c2a1-4f06-997b-6fea959a16d5 req-152d0dbb-1d48-459a-80d4-9cfb0f44c6c8 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:12.057626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-1ed07188-c2a1-4f06-997b-6fea959a16d5 req-152d0dbb-1d48-459a-80d4-9cfb0f44c6c8 service nova] Creating event network-vif-deleted:861bc984-e35a-4369-9f94-3889ac7bd84c for instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b on hv-cinder-78956 Aug 04 16:31:12.068930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-1ed07188-c2a1-4f06-997b-6fea959a16d5 req-152d0dbb-1d48-459a-80d4-9cfb0f44c6c8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040241 Aug 04 16:31:12.070664 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 483/970] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:31:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:12.593592 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:12.594262 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:12.600819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:12.601254 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:12.602118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:12.602545 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:12.644442 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:12.644893 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:12.645357 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lazy-loading 'fault' on Instance uuid 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:31:12.694085 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa31f19acc464a5eb0f2620d763a964d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8a2bb840264572bbf79ff732ee6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:12.704873 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7f428d10-d044-4c26-a7d0-1063f0bcc63f tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 200 len: 1327 microversion: 2.1 time: 0.115917 Aug 04 16:31:12.705634 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 488/971] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:12 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:13.057458 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:13.058306 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:13.066554 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:13.066989 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:13.067761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:13.068216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:13.223183 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:13.231118 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-81d2a6af-8550-4d9d-b525-f9a29c3bdaa9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.178116 Aug 04 16:31:13.231733 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 484/972] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:13 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:13.725564 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:13.727329 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:13.734631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:13.735082 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:13.735871 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:13.736408 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:13.754696 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] HTTP exception thrown: Instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b could not be found. Aug 04 16:31:13.755290 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Returning 404 to user: Instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:13.756372 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8c4a7239-0c67-41cf-9c10-f873f1ffdde3 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 404 len: 111 microversion: 2.1 time: 0.036682 Aug 04 16:31:13.757232 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 489/973] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:13 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:13.767835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-49faa687-8fc6-4a63-9f2e-240c2278b8d1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '.version_select at 0x7f271815b790>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:13.788464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-49faa687-8fc6-4a63-9f2e-240c2278b8d1 tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261278869" status: 202 len: 0 microversion: 2.1 time: 0.025175 Aug 04 16:31:13.789051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 485/974] 10.222.0.77 () {58 vars in 1221 bytes} [Wed Aug 4 16:31:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261278869 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:31:14.249480 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:14.250260 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:14.257022 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:14.258812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:14.258812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:14.259233 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:14.319743 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:14.320984 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:14.328653 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:14.329115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:14.329912 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:14.330377 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:14.359710 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:31:14.448351 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:14.460589 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-67aa446c-6a60-4ef7-8139-a71cf3c21e6d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.214766 Aug 04 16:31:14.461141 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 490/975] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:14 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:14.501798 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-10978cd1-42fd-426c-99a1-91a73d108adb tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 204 len: 0 microversion: 2.20 time: 0.185658 Aug 04 16:31:14.510200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 486/976] 10.222.0.77 () {60 vars in 1280 bytes} [Wed Aug 4 16:31:14 2021] DELETE /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 16:31:14.511317 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:14.512087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:14.518787 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:14.519465 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:14.520431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:14.521011 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:14.680919 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:14.691691 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:14.693624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:14.694845 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6f4f055c-7feb-4076-89f7-7ea40711251d tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.187474 Aug 04 16:31:14.695407 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 491/977] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:31:14 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:31:15.478829 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:15.479512 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:15.490271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:15.490701 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:15.491484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:15.491923 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:15.619667 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:15.628638 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fe550994-34c0-487a-9373-a513dcc7aeb9 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.153826 Aug 04 16:31:15.629219 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 487/978] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:15 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:15.714852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:15.715489 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:15.723900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:15.724371 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:15.726039 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:15.726286 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:15.866071 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:15.875354 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:15.876748 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:15.877963 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9d3a09bf-a8fb-4482-a7dc-fa372f1747b9 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1722 microversion: 2.20 time: 0.166960 Aug 04 16:31:15.878793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 492/979] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:31:15 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:31:16.648897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:16.649644 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:16.657291 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:16.657863 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:16.658700 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:16.659134 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:16.897222 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:16.898431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:16.905189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:16.905610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:16.906672 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:16.907321 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:16.978257 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:16.988133 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:16.990319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efcd395088e74895bd13523cbad21afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94f253973de4174807e633c0f67ea51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:16.991778 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f92f3fb0-8b04-4b42-b8ad-b525f39e5be4 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 200 len: 1654 microversion: 2.20 time: 0.098914 Aug 04 16:31:16.992439 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 493/980] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:31:16 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:31:17.000053 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:17.000960 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:17.008039 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:17.008561 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:17.009519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:17.010058 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:17.026556 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] HTTP exception thrown: Instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b could not be found. Aug 04 16:31:17.027261 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Returning 404 to user: Instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:17.028257 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-56ab7315-8c27-4543-8151-dc7ad064caae tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 404 len: 111 microversion: 2.1 time: 0.034258 Aug 04 16:31:17.030187 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 494/981] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:31:16 2021] DELETE /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:17.041255 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:17.041979 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:17.048391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:17.048817 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:17.049863 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:17.050296 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:17.065150 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] HTTP exception thrown: Instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b could not be found. Aug 04 16:31:17.065583 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Returning 404 to user: Instance 5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:17.066473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d68f59ef-a440-4144-bd12-4d0f02ab23ce tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b" status: 404 len: 111 microversion: 2.1 time: 0.029996 Aug 04 16:31:17.070149 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 495/982] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:17 2021] GET /compute/v2.1/servers/5910e6b6-4ade-47a6-9565-4ffb3ffcdb3b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:17.141168 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:17.150149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-55125b71-a01a-4bca-92e7-ac29dd7f0a45 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.505014 Aug 04 16:31:17.150831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 488/983] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:16 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:17.305612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-e52c4e63-b233-44a6-b760-63e6642527bb req-4b676d13-9082-4ed0-85ce-9720489a43b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dceabbf2-ecd4-497b-997a-1acbda49ddf9", "name": "network-vif-deleted", "tag": "17e1d80b-51b6-4b09-b512-e218dc6eaeaa"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:31:17.307277 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:31:17.307277 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:31:17.315193 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-e52c4e63-b233-44a6-b760-63e6642527bb req-4b676d13-9082-4ed0-85ce-9720489a43b9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:17.315667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-e52c4e63-b233-44a6-b760-63e6642527bb req-4b676d13-9082-4ed0-85ce-9720489a43b9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:17.329761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-e52c4e63-b233-44a6-b760-63e6642527bb req-4b676d13-9082-4ed0-85ce-9720489a43b9 service nova] Creating event network-vif-deleted:17e1d80b-51b6-4b09-b512-e218dc6eaeaa for instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 on hv-cinder-78956 Aug 04 16:31:17.335761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-e52c4e63-b233-44a6-b760-63e6642527bb req-4b676d13-9082-4ed0-85ce-9720489a43b9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033836 Aug 04 16:31:17.336395 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 496/984] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:31:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:18.010521 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:18.011824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:18.018802 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.019229 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.020222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.020737 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.035849 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] HTTP exception thrown: Instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 could not be found. Aug 04 16:31:18.036551 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Returning 404 to user: Instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:18.037669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d9b0e0c7-8e1d-4014-bd68-fe8be20bd3f8 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 404 len: 111 microversion: 2.20 time: 0.031038 Aug 04 16:31:18.038315 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 489/985] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 4 16:31:18 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:31:18.053900 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c1b65480-2792-4644-b068-7aebded5feb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '.version_select at 0x7f2718137820>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:18.076749 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c1b65480-2792-4644-b068-7aebded5feb7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885254945" status: 204 len: 0 microversion: 2.20 time: 0.031936 Aug 04 16:31:18.077295 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 497/986] 10.222.0.77 () {60 vars in 1259 bytes} [Wed Aug 4 16:31:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885254945 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:31:18.167308 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:18.167915 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:18.174342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.174782 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.175568 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.175992 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.218257 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:18.218888 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:18.225972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.226725 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.228182 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.228568 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.243153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] HTTP exception thrown: Instance ee88d756-5674-4fae-a650-a006454697e6 could not be found. Aug 04 16:31:18.243744 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Returning 404 to user: Instance ee88d756-5674-4fae-a650-a006454697e6 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:18.244608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f723c54b-2fbf-4c8d-b607-10e086659b8b tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 404 len: 111 microversion: 2.1 time: 0.030426 Aug 04 16:31:18.245602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 498/987] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:31:18 2021] DELETE /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:18.255125 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:18.256121 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] [instance: ee88d756-5674-4fae-a650-a006454697e6] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:18.264428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.265153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.266141 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:18.266738 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:18.287659 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] HTTP exception thrown: Instance ee88d756-5674-4fae-a650-a006454697e6 could not be found. Aug 04 16:31:18.288735 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] Returning 404 to user: Instance ee88d756-5674-4fae-a650-a006454697e6 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:18.289732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1c11b025-1731-491a-955f-4c70793515ff tempest-AttachVolumeTestJSON-676209429 tempest-AttachVolumeTestJSON-676209429-project] 10.222.0.77 "GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6" status: 404 len: 111 microversion: 2.1 time: 0.038343 Aug 04 16:31:18.290472 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 499/988] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:18 2021] GET /compute/v2.1/servers/ee88d756-5674-4fae-a650-a006454697e6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:18.335210 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:18.347027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-78217526-847d-4752-bd82-316264fca65f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.183311 Aug 04 16:31:18.357438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 490/989] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:18 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:19.364654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:19.365266 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:19.371128 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:19.371573 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:19.372529 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:19.373126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:19.620866 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:19.628812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9e4aa6a8-f95e-4cdc-bc4f-db33228d80de tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.268204 Aug 04 16:31:19.629573 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 500/990] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:19 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:31:20.004488 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:20.004997 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:20.011658 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:20.012106 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:20.012907 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:20.013340 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:20.028808 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] HTTP exception thrown: Instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 could not be found. Aug 04 16:31:20.030546 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Returning 404 to user: Instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:20.031407 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-179da7d8-601f-419b-bad9-3d9358414507 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 404 len: 111 microversion: 2.1 time: 0.030680 Aug 04 16:31:20.032719 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 491/991] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:31:19 2021] DELETE /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:20.040978 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:20.041852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: dceabbf2-ecd4-497b-997a-1acbda49ddf9] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:20.047806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:20.048241 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:20.049207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:20.049830 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:20.064590 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] HTTP exception thrown: Instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 could not be found. Aug 04 16:31:20.065177 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Returning 404 to user: Instance dceabbf2-ecd4-497b-997a-1acbda49ddf9 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:20.066033 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-ee7538af-825d-47b3-ad5a-9e2c65019b2c tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9" status: 404 len: 111 microversion: 2.1 time: 0.029214 Aug 04 16:31:20.066602 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 501/992] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:20 2021] GET /compute/v2.1/servers/dceabbf2-ecd4-497b-997a-1acbda49ddf9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:20.646018 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:20.646634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:20.653826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:20.655920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:20.656764 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:20.657511 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:20.948443 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:20.959470 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e54b8984-f847-419d-8f36-59af5abee05e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.317182 Aug 04 16:31:20.960456 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 492/993] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:20 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:21.214612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:21.215216 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:21.221287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:21.221724 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:21.222529 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:21.222948 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:21.236756 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] HTTP exception thrown: Instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 could not be found. Aug 04 16:31:21.237343 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Returning 404 to user: Instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:21.238177 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b837d4d1-0b30-4203-bb4c-f837011ba22a tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "DELETE /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 404 len: 111 microversion: 2.1 time: 0.027408 Aug 04 16:31:21.238732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 502/994] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:31:21 2021] DELETE /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:21.246681 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:21.247998 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] [instance: 7e525871-8d1f-4462-9cb5-7e3aeb9c3977] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:21.254366 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:21.255032 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:21.255976 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:21.256552 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:21.271870 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] HTTP exception thrown: Instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 could not be found. Aug 04 16:31:21.272758 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] Returning 404 to user: Instance 7e525871-8d1f-4462-9cb5-7e3aeb9c3977 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:31:21.273589 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5dea57a3-3de8-491e-95a3-9fe5cbb739f7 tempest-AttachVolumeShelveTestJSON-1559102641 tempest-AttachVolumeShelveTestJSON-1559102641-project] 10.222.0.77 "GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977" status: 404 len: 111 microversion: 2.1 time: 0.030611 Aug 04 16:31:21.274331 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 493/995] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:21 2021] GET /compute/v2.1/servers/7e525871-8d1f-4462-9cb5-7e3aeb9c3977 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:31:21.976677 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:21.977342 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:21.984093 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:21.984596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:21.985334 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:21.985766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:22.187340 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:22.196391 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-64627b5b-7cdd-44d9-b767-8b034070c53d tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.223455 Aug 04 16:31:22.197254 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 503/996] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:21 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:23.221751 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:23.222437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:23.229031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:23.229538 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:23.230521 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:23.230955 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:23.379362 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:23.397635 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b0114bd7-1607-43cc-b9d4-2f66f5f93bde tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.180852 Aug 04 16:31:23.399022 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 494/997] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:23 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:24.415939 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:24.416937 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:24.424429 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:24.424865 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:24.425637 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:24.426087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:24.540497 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4f77dfa0-af30-454c-8fe8-669b16fd378a tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27181c2b80>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:24.571538 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:24.580887 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-3d861fcb-4482-457e-b2b3-899341332d00 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.168851 Aug 04 16:31:24.581884 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 504/998] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:24 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:24.605535 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4f77dfa0-af30-454c-8fe8-669b16fd378a tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/2e483f6a-73e6-4455-8b0e-b6cb5419abf8" status: 200 len: 350 microversion: 2.1 time: 0.082656 Aug 04 16:31:24.606136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 495/999] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:31:24 2021] GET /compute/v2.1/os-volumes/2e483f6a-73e6-4455-8b0e-b6cb5419abf8 => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:31:25.598306 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:25.598915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:25.605087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:25.605762 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:25.606623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:25.607090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:25.736528 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:25.744120 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-757c2f6d-0dbc-4c51-a70b-e3c7baee49ce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.149556 Aug 04 16:31:25.744890 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 505/1000] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:25 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:26.038185 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-07f0b382-3c9c-4ef4-8959-e597b1187938 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f2718219670>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:26.091533 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-07f0b382-3c9c-4ef4-8959-e597b1187938 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/50e976eb-0f5b-430d-a3b6-0dbb495ae787" status: 200 len: 351 microversion: 2.1 time: 0.056832 Aug 04 16:31:26.092399 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 496/1001] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:31:26 2021] GET /compute/v2.1/os-volumes/50e976eb-0f5b-430d-a3b6-0dbb495ae787 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:26.761637 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:26.762273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:26.768714 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:26.769164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:26.770060 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:26.773686 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:26.905912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:26.919418 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-99ecea61-b2d6-4bb9-8d81-51645ae3b1e7 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.161012 Aug 04 16:31:26.920425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 506/1002] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:26 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:31:27.493020 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7b620fcb-daf1-4bda-843e-adb89c87064a tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27181bf790>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:27.553543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7b620fcb-daf1-4bda-843e-adb89c87064a tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/e539ebd4-7406-4403-a07a-3bcea2264a61" status: 200 len: 350 microversion: 2.1 time: 0.064374 Aug 04 16:31:27.554298 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 497/1003] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 4 16:31:27 2021] GET /compute/v2.1/os-volumes/e539ebd4-7406-4403-a07a-3bcea2264a61 => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:27.565725 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-490b57ea-c7e7-4fbe-9ee4-fbbfc7d94a68 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f2718144700>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:27.648992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-490b57ea-c7e7-4fbe-9ee4-fbbfc7d94a68 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087140 Aug 04 16:31:27.649562 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 507/1004] 10.222.0.77 () {58 vars in 1134 bytes} [Wed Aug 4 16:31:27 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:27.662561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6f1e1433-5d9d-4fed-a626-bda16e7b2141 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27181bf8b0>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:27.748460 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6f1e1433-5d9d-4fed-a626-bda16e7b2141 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089445 Aug 04 16:31:27.749051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 498/1005] 10.222.0.77 () {58 vars in 1149 bytes} [Wed Aug 4 16:31:27 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:27.761459 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2f6008a3-4822-458a-b987-92f9b8fc2cc6 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27180c5c10>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:27.944822 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:27.945912 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:27.953767 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:27.954378 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:27.955640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:27.956156 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:28.010162 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2f6008a3-4822-458a-b987-92f9b8fc2cc6 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.252387 Aug 04 16:31:28.010806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 508/1006] 10.222.0.77 () {58 vars in 1134 bytes} [Wed Aug 4 16:31:27 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:28.022244 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-629369f5-6958-4482-9869-ec03928df76f tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27180a7ca0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:28.109757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:28.116369 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-629369f5-6958-4482-9869-ec03928df76f tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097322 Aug 04 16:31:28.117595 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 509/1007] 10.222.0.77 () {58 vars in 1167 bytes} [Wed Aug 4 16:31:28 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:28.122548 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-840e5fd6-487d-4d1e-9015-3300f62fd5b4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.181372 Aug 04 16:31:28.123425 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 499/1008] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:27 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:31:28.136242 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-5f6aceeb-9850-4544-b769-9e2d673ed6a2 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27180a70d0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:28.217463 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-5f6aceeb-9850-4544-b769-9e2d673ed6a2 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088159 Aug 04 16:31:28.218064 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 510/1009] 10.222.0.77 () {58 vars in 1170 bytes} [Wed Aug 4 16:31:28 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:31:28.230119 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-260f1692-1dd8-4129-a476-d438e6f00ddc tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27181c2e50>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:28.311573 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-260f1692-1dd8-4129-a476-d438e6f00ddc tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085122 Aug 04 16:31:28.312135 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 500/1010] 10.222.0.77 () {58 vars in 1155 bytes} [Wed Aug 4 16:31:28 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:28.330911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-6b599e32-4001-43c9-9a1c-d737c387b151 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f271804c3a0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:28.413760 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-6b599e32-4001-43c9-9a1c-d737c387b151 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086516 Aug 04 16:31:28.414377 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 511/1011] 10.222.0.77 () {58 vars in 1188 bytes} [Wed Aug 4 16:31:28 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:28.426531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-06478c9a-90d5-4207-bd31-8b23b193ef61 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] Calling method '.version_select at 0x7f27181bf160>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:28.516957 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-06478c9a-90d5-4207-bd31-8b23b193ef61 tempest-VolumesTestJSON-840216528 tempest-VolumesTestJSON-840216528-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093842 Aug 04 16:31:28.527427 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 501/1012] 10.222.0.77 () {58 vars in 1155 bytes} [Wed Aug 4 16:31:28 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:29.141200 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:29.141852 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:29.148717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:29.149162 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:29.149972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:29.150403 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:29.284468 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:29.292141 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9f72504f-f8cc-4051-b052-59ee7af3614e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.155599 Aug 04 16:31:29.292712 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 512/1013] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:29 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:30.309397 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:30.310517 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:30.330098 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:30.330615 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:30.331400 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:30.331874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:30.460506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:30.468251 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-84e76697-13b2-4d8f-9499-5c14abeaaad4 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1570 microversion: 2.1 time: 0.163023 Aug 04 16:31:30.468836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 502/1014] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:30 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:30.484814 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-12fa6db8-c8e3-41e0-b249-5e1f24fbc6b3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:31:30.485404 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-12fa6db8-c8e3-41e0-b249-5e1f24fbc6b3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:30.491449 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-12fa6db8-c8e3-41e0-b249-5e1f24fbc6b3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:30.491885 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-12fa6db8-c8e3-41e0-b249-5e1f24fbc6b3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:30.492655 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-12fa6db8-c8e3-41e0-b249-5e1f24fbc6b3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:30.493070 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-12fa6db8-c8e3-41e0-b249-5e1f24fbc6b3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:30.570255 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-12fa6db8-c8e3-41e0-b249-5e1f24fbc6b3 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "POST /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4/action" status: 202 len: 0 microversion: 2.1 time: 0.089446 Aug 04 16:31:30.571119 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 513/1015] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 4 16:31:30 2021] POST /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:31:30.580322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:30.580894 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:30.587222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:30.587668 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:30.588481 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:30.588941 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:30.747968 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:30.756176 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-7615af6b-7916-46b9-8c05-d875e38f8cbb tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1518 microversion: 2.1 time: 0.180245 Aug 04 16:31:30.757201 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 503/1016] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:30 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:31.783401 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:31.784001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:31.790295 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:31.790759 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:31.791609 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:31.792052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:31.924425 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:31.932002 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d3c92434-7577-4588-99bb-acba4d4d548f tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.153227 Aug 04 16:31:31.932772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 514/1017] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:31 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:32.950989 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:32.951603 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:32.958027 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:32.958780 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:32.959790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:32.960938 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:33.117821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:33.126271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-213e1df1-ba38-4835-a8c9-951e6dc9ac2e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.179336 Aug 04 16:31:33.126844 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 504/1018] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:32 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:34.122643 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-3ae20669-8b60-4a2d-b8ee-3257b4bc09b0 req-159c15d3-8bc9-4e10-8b7a-fc5e9a3f7c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cc5de9-b97f-4969-b926-672feb3d04e4", "name": "network-vif-unplugged", "status": "completed", "tag": "e6adc942-2649-44f9-a5ef-fe285a7906d7"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:31:34.126319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:31:34.126319 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:31:34.140771 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-3ae20669-8b60-4a2d-b8ee-3257b4bc09b0 req-159c15d3-8bc9-4e10-8b7a-fc5e9a3f7c19 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:34.141206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-3ae20669-8b60-4a2d-b8ee-3257b4bc09b0 req-159c15d3-8bc9-4e10-8b7a-fc5e9a3f7c19 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:34.149198 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:34.150556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:34.157132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:34.157989 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:34.159002 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:34.160180 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:34.165667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-3ae20669-8b60-4a2d-b8ee-3257b4bc09b0 req-159c15d3-8bc9-4e10-8b7a-fc5e9a3f7c19 service nova] Creating event network-vif-unplugged:e6adc942-2649-44f9-a5ef-fe285a7906d7 for instance 30cc5de9-b97f-4969-b926-672feb3d04e4 on hv-cinder-78956 Aug 04 16:31:34.177684 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-3ae20669-8b60-4a2d-b8ee-3257b4bc09b0 req-159c15d3-8bc9-4e10-8b7a-fc5e9a3f7c19 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062199 Aug 04 16:31:34.178782 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 515/1019] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:31:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:31:34.367113 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:34.377990 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-20943358-345b-43e9-93e3-a429113e10c6 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.232104 Aug 04 16:31:34.379169 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 505/1020] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:34 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:35.395006 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:35.395705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:35.402475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:35.402904 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:35.403675 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:35.404596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:35.599059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:35.606399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-baf21126-4325-40fe-afc4-a714ffcca1e1 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.215410 Aug 04 16:31:35.607063 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 516/1021] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:35 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:36.623684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:36.624298 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:36.630654 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:36.631479 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:36.632248 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:36.632799 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:36.848756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:36.856501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-a46e7174-d9aa-47e5-9d4a-a93bdf589425 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.236571 Aug 04 16:31:36.858110 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 506/1022] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:36 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:37.875610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:37.876263 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:37.883501 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:37.883964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:37.884846 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:37.885640 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:38.038371 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:38.046728 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0c783f1c-b3d2-4c37-aa3a-0b5cbc1f5680 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.175509 Aug 04 16:31:38.047322 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 517/1023] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:37 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:39.068372 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:39.069078 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:39.076714 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:39.077173 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:39.078032 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:39.078473 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:39.227527 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:39.235812 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d59c207f-cd4d-4f60-a7a0-06150e6457b0 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.171167 Aug 04 16:31:39.236417 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 507/1024] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:39 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:40.253506 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:40.254164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:40.260654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:40.261126 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:40.261911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:40.262378 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:40.412766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:40.420983 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a6fc4ba0-1f93-4cbd-bc8e-dbb31b0f7975 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.171358 Aug 04 16:31:40.421565 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 518/1025] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:40 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:41.439160 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:41.439894 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:41.446419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:41.446821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:41.447593 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:41.448026 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:41.576617 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:41.584184 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-64799d8d-6db3-4dfb-91f3-f1fdccde8c28 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1576 microversion: 2.1 time: 0.148964 Aug 04 16:31:41.584823 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 508/1026] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:41 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:31:42.601322 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:31:42.602118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:31:42.609754 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:42.610392 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:42.611428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:42.611988 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:42.756883 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:31:42.764959 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c2a4d88f-df83-4437-b1ba-3daef86b7fce tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1563 microversion: 2.1 time: 0.167507 Aug 04 16:31:42.765529 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 519/1027] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:31:42 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:31:46.126609 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-d260d5e0-bedf-41e0-b4cf-edba4241b090 req-29c80df2-d015-4ce6-b5aa-e6ae2dbf561a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cc5de9-b97f-4969-b926-672feb3d04e4", "name": "network-vif-plugged", "status": "completed", "tag": "e6adc942-2649-44f9-a5ef-fe285a7906d7"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:31:46.128275 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:31:46.128275 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:31:46.135841 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-d260d5e0-bedf-41e0-b4cf-edba4241b090 req-29c80df2-d015-4ce6-b5aa-e6ae2dbf561a service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:31:46.136282 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-d260d5e0-bedf-41e0-b4cf-edba4241b090 req-29c80df2-d015-4ce6-b5aa-e6ae2dbf561a service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:31:46.149878 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-d260d5e0-bedf-41e0-b4cf-edba4241b090 req-29c80df2-d015-4ce6-b5aa-e6ae2dbf561a service nova] Creating event network-vif-plugged:e6adc942-2649-44f9-a5ef-fe285a7906d7 for instance 30cc5de9-b97f-4969-b926-672feb3d04e4 on hv-cinder-78956 Aug 04 16:31:46.155897 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-d260d5e0-bedf-41e0-b4cf-edba4241b090 req-29c80df2-d015-4ce6-b5aa-e6ae2dbf561a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Aug 04 16:31:46.156526 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 509/1028] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:31:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:20.135854 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:32:20.136944 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:32:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:32:43.908365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-989480023", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "f84a14b4-6ae5-49a8-9b82-a4cd22df649c"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:43.965908 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] validate_networks() for [('f84a14b4-6ae5-49a8-9b82-a4cd22df649c', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:32:44.381828 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:32:44.382281 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:32:44.382744 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:32:44.383142 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:32:44.383574 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:32:44.392734 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:44.393175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:44.393992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:44.394437 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:44.412164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Getting quotas for project 166850251ba549a2b5a7b0058be05b33. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:32:44.416469 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Getting quotas for user d7ca07ad0e944763baea070ca0f12177 and project 166850251ba549a2b5a7b0058be05b33. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:32:44.427498 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:32:44.429886 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:32:44.475232 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f8fdf3b0-c6be-4571-9259-2554eb4b5e17 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571984 Aug 04 16:32:44.475875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 520/1029] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:32:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:32:44.487039 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fd3f5d7f-e780-4f24-8b14-0b05129fb2c4 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.487736 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fd3f5d7f-e780-4f24-8b14-0b05129fb2c4 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:44.542323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fd3f5d7f-e780-4f24-8b14-0b05129fb2c4 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:44.550210 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fd3f5d7f-e780-4f24-8b14-0b05129fb2c4 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1218 microversion: 2.1 time: 0.067861 Aug 04 16:32:44.550829 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 510/1030] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:44 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:45.567795 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.568369 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:45.575580 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:45.576029 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:45.576816 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:45.577242 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:45.640585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:45.648882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1e407a62-a34d-4a49-945e-02e3bfa186f5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1270 microversion: 2.1 time: 0.084865 Aug 04 16:32:45.649465 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 521/1031] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:45 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:46.666650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:46.667259 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:46.674875 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:46.675327 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:46.676108 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:46.676541 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:46.904140 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:46.911820 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-671bc976-cf22-42d8-bd0a-b64b6432ed70 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.249019 Aug 04 16:32:46.912401 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 511/1032] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:46 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:47.250629 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 16:32:47.254858 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-0bf0aed0-1d7b-4062-9b95-6a70def59d8b req-1cfbc0ef-0205-4234-ba6a-133e49657e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d1361f-85db-4657-97bd-38f4b84766bf", "tag": "59cccf08-f8a7-44d4-a688-6711abe584ec"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:47.256982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:47.256982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:32:47.265306 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-0bf0aed0-1d7b-4062-9b95-6a70def59d8b req-1cfbc0ef-0205-4234-ba6a-133e49657e38 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:47.265745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-0bf0aed0-1d7b-4062-9b95-6a70def59d8b req-1cfbc0ef-0205-4234-ba6a-133e49657e38 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:47.277920 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-0bf0aed0-1d7b-4062-9b95-6a70def59d8b req-1cfbc0ef-0205-4234-ba6a-133e49657e38 service nova] Creating event network-changed:59cccf08-f8a7-44d4-a688-6711abe584ec for instance 32d1361f-85db-4657-97bd-38f4b84766bf on hv-cinder-78956 Aug 04 16:32:47.284087 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-0bf0aed0-1d7b-4062-9b95-6a70def59d8b req-1cfbc0ef-0205-4234-ba6a-133e49657e38 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034700 Aug 04 16:32:47.284687 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 522/1033] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:47.929586 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:47.930301 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:47.937119 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:47.937572 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:47.938392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:47.938827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:48.064257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:48.072309 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c8bede2a-1ec6-439f-9d03-e5caf75ae69f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.146487 Aug 04 16:32:48.072876 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 512/1034] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:47 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:49.089605 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:49.090328 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:49.109491 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:49.109931 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:49.110740 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:49.111194 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:49.116724 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 56114. Aug 04 16:32:49.252065 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:49.260186 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d252e2c1-e783-4b31-afca-98cbcd2799be tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.174638 Aug 04 16:32:49.260748 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 523/1035] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:49 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:50.277787 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:50.279136 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:50.285367 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:50.285797 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:50.286666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:50.287105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:50.525830 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:50.534130 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-f49c8558-579d-4d9b-b224-88377371fe5c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.260058 Aug 04 16:32:50.534782 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 513/1036] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:50 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:51.551267 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:51.551882 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:51.558508 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:51.558960 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:51.559740 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:51.560201 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:51.687717 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:51.695793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f87cb602-9f72-41f6-b3df-2d7398eec522 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.148268 Aug 04 16:32:51.696719 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 524/1037] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:51 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:52.713144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.713765 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:52.720524 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:52.720969 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:52.721739 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:52.722211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:52.853667 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:52.862673 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e2f43b52-4d5c-4c0c-8984-12ffcd5dbc90 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.153105 Aug 04 16:32:52.863279 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 514/1038] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:52 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:53.880207 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:53.880838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:53.887454 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:53.887897 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:53.888670 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:53.889099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:54.023109 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:54.032463 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-9aac38ed-ebea-4116-8ea0-6631978a91cb tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.155914 Aug 04 16:32:54.033055 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 525/1039] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:53 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:55.049756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:55.050378 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:55.056757 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:55.057206 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:55.057982 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:55.058450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:55.202499 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:55.212288 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-d8ed19ca-0910-4e2c-81f7-88254529d72e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.166219 Aug 04 16:32:55.212857 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 515/1040] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:55 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:56.233293 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:56.234263 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:56.241531 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:56.242219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:56.243106 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:56.243612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:56.398962 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:56.406474 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-989e2b51-835c-4ae6-8956-1b25584a915e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.178260 Aug 04 16:32:56.407273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 526/1041] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:56 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:56.629179 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-83cbf680-67fc-4c05-9931-6e078dadb296 req-d7279453-f8bc-45e3-a22c-eb7ffb4cdfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d1361f-85db-4657-97bd-38f4b84766bf", "name": "network-vif-plugged", "status": "completed", "tag": "59cccf08-f8a7-44d4-a688-6711abe584ec"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:56.631095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:56.631095 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:32:56.639825 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-83cbf680-67fc-4c05-9931-6e078dadb296 req-d7279453-f8bc-45e3-a22c-eb7ffb4cdfc9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:56.640906 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-83cbf680-67fc-4c05-9931-6e078dadb296 req-d7279453-f8bc-45e3-a22c-eb7ffb4cdfc9 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:56.654304 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-83cbf680-67fc-4c05-9931-6e078dadb296 req-d7279453-f8bc-45e3-a22c-eb7ffb4cdfc9 service nova] Creating event network-vif-plugged:59cccf08-f8a7-44d4-a688-6711abe584ec for instance 32d1361f-85db-4657-97bd-38f4b84766bf on hv-cinder-78956 Aug 04 16:32:56.659983 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-83cbf680-67fc-4c05-9931-6e078dadb296 req-d7279453-f8bc-45e3-a22c-eb7ffb4cdfc9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034846 Aug 04 16:32:56.660952 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 516/1042] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:32:57.424110 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:57.424745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:57.431378 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:57.431845 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:57.432626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:57.433054 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:57.561151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:57.568929 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-881f95b8-5892-4cb8-a81b-91a1ba0074ef tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1318 microversion: 2.1 time: 0.148607 Aug 04 16:32:57.569503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 527/1043] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:57 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:58.587666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:58.588222 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:32:58.595452 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:58.595889 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:58.596661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:32:58.597077 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:32:58.723768 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:58.731821 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2d6a3fa1-07a2-4524-a323-70b3413fb78e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1507 microversion: 2.1 time: 0.148346 Aug 04 16:32:58.732386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 517/1044] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:32:58 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:06.181743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:06.181743 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:06.183272 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-9e6c516c-7295-4ee4-98bb-4becc8424050 req-661f61dd-d941-463d-959d-7497299c7ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cc5de9-b97f-4969-b926-672feb3d04e4", "tag": "e6adc942-2649-44f9-a5ef-fe285a7906d7"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:06.186181 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:06.186181 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:33:06.190274 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:06.191109 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:06.192304 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:06.192989 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:06.194223 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-9e6c516c-7295-4ee4-98bb-4becc8424050 req-661f61dd-d941-463d-959d-7497299c7ecc service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:06.194680 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-9e6c516c-7295-4ee4-98bb-4becc8424050 req-661f61dd-d941-463d-959d-7497299c7ecc service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:06.207506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-9e6c516c-7295-4ee4-98bb-4becc8424050 req-661f61dd-d941-463d-959d-7497299c7ecc service nova] Creating event network-changed:e6adc942-2649-44f9-a5ef-fe285a7906d7 for instance 30cc5de9-b97f-4969-b926-672feb3d04e4 on hv-cinder-78956 Aug 04 16:33:06.212946 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-9e6c516c-7295-4ee4-98bb-4becc8424050 req-661f61dd-d941-463d-959d-7497299c7ecc service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033375 Aug 04 16:33:06.214019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 518/1045] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:33:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:06.225650 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:33:06.311213 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-99a789f5-701a-49df-b88c-6c544aef0411 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "DELETE /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 204 len: 0 microversion: 2.1 time: 0.133413 Aug 04 16:33:06.311945 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 528/1046] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:33:06 2021] DELETE /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:33:06.321388 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:06.323167 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:06.333249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:06.333826 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:06.334784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:06.335417 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:06.581846 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:06.589718 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2fa0bbba-93c9-4f10-9fec-d4c7b30e5671 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1569 microversion: 2.1 time: 0.273105 Aug 04 16:33:06.590790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 519/1047] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:06 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1569 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:07.607310 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:07.608008 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:07.614314 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:07.614762 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:07.615549 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:07.616151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:07.744285 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:07.753004 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-2e03e939-f73f-4e8f-b0cf-1e73b4a1d48e tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1450 microversion: 2.1 time: 0.149702 Aug 04 16:33:07.753803 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 529/1048] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:07 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:08.630325 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-7c7d2158-3155-4bce-9213-a18fe9e96cc2 req-8182ff94-3b7c-4378-9c0f-d63a9f9b5834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cc5de9-b97f-4969-b926-672feb3d04e4", "name": "network-vif-deleted", "tag": "e6adc942-2649-44f9-a5ef-fe285a7906d7"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:08.631853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:08.631853 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:33:08.641418 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-7c7d2158-3155-4bce-9213-a18fe9e96cc2 req-8182ff94-3b7c-4378-9c0f-d63a9f9b5834 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:08.641891 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-7c7d2158-3155-4bce-9213-a18fe9e96cc2 req-8182ff94-3b7c-4378-9c0f-d63a9f9b5834 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:08.654639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-7c7d2158-3155-4bce-9213-a18fe9e96cc2 req-8182ff94-3b7c-4378-9c0f-d63a9f9b5834 service nova] Creating event network-vif-deleted:e6adc942-2649-44f9-a5ef-fe285a7906d7 for instance 30cc5de9-b97f-4969-b926-672feb3d04e4 on hv-cinder-78956 Aug 04 16:33:08.659619 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-7c7d2158-3155-4bce-9213-a18fe9e96cc2 req-8182ff94-3b7c-4378-9c0f-d63a9f9b5834 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Aug 04 16:33:08.660257 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 520/1049] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:08.770784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:08.771404 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:08.777962 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:08.778444 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:08.779198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:08.779663 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:08.841984 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867b156b0c2741d1b60d95f9d9df2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76829aee5bb64de2bb202e81a575e30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:08.849850 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7ade5330-7f65-4eab-a867-81cf2486151a tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 200 len: 1219 microversion: 2.1 time: 0.082628 Aug 04 16:33:08.850365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 530/1050] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:08 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:09.867669 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:09.868255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] [instance: 30cc5de9-b97f-4969-b926-672feb3d04e4] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:09.875079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:09.875560 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:09.876324 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:09.876752 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:09.891157 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] HTTP exception thrown: Instance 30cc5de9-b97f-4969-b926-672feb3d04e4 could not be found. Aug 04 16:33:09.891752 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Returning 404 to user: Instance 30cc5de9-b97f-4969-b926-672feb3d04e4 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:33:09.892594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3bda84f3-f7c3-4a7f-8ad3-21a69f13c366 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4" status: 404 len: 111 microversion: 2.1 time: 0.029256 Aug 04 16:33:09.893142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 521/1051] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:09 2021] GET /compute/v2.1/servers/30cc5de9-b97f-4969-b926-672feb3d04e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:10.068710 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f7d11122-faeb-45eb-8fbe-4e115ff07f78 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] Calling method '.version_select at 0x7f271804c9d0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:10.092299 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f7d11122-faeb-45eb-8fbe-4e115ff07f78 tempest-TestShelveInstance-1242085951 tempest-TestShelveInstance-1242085951-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-935437709" status: 202 len: 0 microversion: 2.1 time: 0.029267 Aug 04 16:33:10.092934 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 531/1052] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 4 16:33:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-935437709 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:16.117830 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fb441ce6-2cd8-4de6-b905-3e03fde42b16 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "978e4fec-9ef2-4981-bc38-094a5db78512", "device": "/dev/sdb"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:16.120317 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fb441ce6-2cd8-4de6-b905-3e03fde42b16 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:16.126787 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb441ce6-2cd8-4de6-b905-3e03fde42b16 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:16.127234 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb441ce6-2cd8-4de6-b905-3e03fde42b16 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:16.128019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb441ce6-2cd8-4de6-b905-3e03fde42b16 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:16.128439 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fb441ce6-2cd8-4de6-b905-3e03fde42b16 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:16.462268 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fb441ce6-2cd8-4de6-b905-3e03fde42b16 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "POST /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348187 Aug 04 16:33:16.463341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 522/1053] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:33:16 2021] POST /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:39.083695 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:39.084599 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:39.091518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:39.091956 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:39.092737 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:39.093164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:39.191933 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lazy-loading 'services' on Instance uuid 32d1361f-85db-4657-97bd-38f4b84766bf {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:39.262267 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-98d18544-3a32-41a6-a3fd-f4e06d2f353f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "DELETE /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf/os-volume_attachments/978e4fec-9ef2-4981-bc38-094a5db78512" status: 202 len: 0 microversion: 2.1 time: 0.185213 Aug 04 16:33:39.262879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 532/1054] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:33:39 2021] DELETE /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf/os-volume_attachments/978e4fec-9ef2-4981-bc38-094a5db78512 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:40.407967 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:40.408599 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:40.416402 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:40.416850 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:40.417627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:40.418141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:40.446020 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:33:40.530933 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ecc343c3-538a-45f5-affb-88ac57bf0303 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "DELETE /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 204 len: 0 microversion: 2.1 time: 0.128056 Aug 04 16:33:40.531510 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 523/1055] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:33:40 2021] DELETE /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:33:40.540508 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:40.541205 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:40.548582 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:40.549045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:40.549797 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:40.550276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:40.678821 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:40.687611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a23643ab-55df-4479-8c78-5fc3a49302d8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1513 microversion: 2.1 time: 0.151182 Aug 04 16:33:40.688185 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 533/1056] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:40 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:41.706666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.707369 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:41.714191 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:41.714632 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:41.715426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:41.715891 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:41.871646 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:41.880230 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-90196da3-68f5-423c-88ca-c6cfc6f1a8b8 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1513 microversion: 2.1 time: 0.177746 Aug 04 16:33:41.880790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 524/1057] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:41 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:42.841688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-743a5781-acba-4fbf-a47e-c7c7c434e372 req-d0b851f9-b01b-4afb-afe3-2c37cf48f8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d1361f-85db-4657-97bd-38f4b84766bf", "name": "network-vif-deleted", "tag": "59cccf08-f8a7-44d4-a688-6711abe584ec"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:42.843991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:42.843991 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:33:42.853299 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-743a5781-acba-4fbf-a47e-c7c7c434e372 req-d0b851f9-b01b-4afb-afe3-2c37cf48f8e1 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:42.853890 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-743a5781-acba-4fbf-a47e-c7c7c434e372 req-d0b851f9-b01b-4afb-afe3-2c37cf48f8e1 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:42.871926 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-743a5781-acba-4fbf-a47e-c7c7c434e372 req-d0b851f9-b01b-4afb-afe3-2c37cf48f8e1 service nova] Creating event network-vif-deleted:59cccf08-f8a7-44d4-a688-6711abe584ec for instance 32d1361f-85db-4657-97bd-38f4b84766bf on hv-cinder-78956 Aug 04 16:33:42.877820 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-743a5781-acba-4fbf-a47e-c7c7c434e372 req-d0b851f9-b01b-4afb-afe3-2c37cf48f8e1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039976 Aug 04 16:33:42.878460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 534/1058] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:42.897254 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:42.898738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:42.906944 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:42.907394 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:42.908153 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:42.908575 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:42.982319 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:42.991421 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5fd7b7c5-74f4-4d61-9192-2aaf42c335a9 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 200 len: 1303 microversion: 2.1 time: 0.098264 Aug 04 16:33:42.992008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 525/1059] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:42 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:44.009597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:44.010309 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 32d1361f-85db-4657-97bd-38f4b84766bf] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:44.016982 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:44.017431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:44.018244 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:44.018680 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:44.033807 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] HTTP exception thrown: Instance 32d1361f-85db-4657-97bd-38f4b84766bf could not be found. Aug 04 16:33:44.034448 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Returning 404 to user: Instance 32d1361f-85db-4657-97bd-38f4b84766bf could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:33:44.035305 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8a1b0b46-5873-45c2-a02d-103cbfd1782e tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf" status: 404 len: 111 microversion: 2.1 time: 0.029831 Aug 04 16:33:44.035864 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 535/1060] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:44 2021] GET /compute/v2.1/servers/32d1361f-85db-4657-97bd-38f4b84766bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:53.895536 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1485376208", "imageRef": "b43bccc0-3712-4ec3-9c90-5327e6e9891e", "flavorRef": "452", "networks": [{"uuid": "f84a14b4-6ae5-49a8-9b82-a4cd22df649c"}]}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:53.956420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.network.neutron [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] validate_networks() for [('f84a14b4-6ae5-49a8-9b82-a4cd22df649c', None, None, None)] {{(pid=107558) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:33:54.302721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Flavor limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:54.303205 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Image limits 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:54.303684 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Flavor pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:54.304087 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Image pref 0:0:0 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:54.304494 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.virt.hardware [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:54.313840 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:54.314241 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:54.315019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:54.315447 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:54.332385 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Getting quotas for project 166850251ba549a2b5a7b0058be05b33. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:33:54.336344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Getting quotas for user d7ca07ad0e944763baea070ca0f12177 and project 166850251ba549a2b5a7b0058be05b33. Resources: {'instances', 'cores', 'ram'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:33:54.347307 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Going to run 1 instances... {{(pid=107558) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:33:54.349658 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b43bccc0-3712-4ec3-9c90-5327e6e9891e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:33:54.402518 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-93753d83-dd49-4385-ada5-1026943975aa tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510634 Aug 04 16:33:54.403309 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 526/1061] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:33:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:33:54.416285 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-709919fb-40e1-4b0d-bf57-4a29e9aef63c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:54.417311 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-709919fb-40e1-4b0d-bf57-4a29e9aef63c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:54.485925 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-709919fb-40e1-4b0d-bf57-4a29e9aef63c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:54.493081 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-709919fb-40e1-4b0d-bf57-4a29e9aef63c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1219 microversion: 2.1 time: 0.081630 Aug 04 16:33:54.493656 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 536/1062] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:54 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:55.512119 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:55.513494 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:55.521857 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:55.522420 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:55.523651 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:55.524242 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:55.676297 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:55.686410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5581799b-ce64-4928-9b47-c4ea6ef391c6 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1289 microversion: 2.1 time: 0.178720 Aug 04 16:33:55.687464 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 527/1063] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:55 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1289 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:56.719251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:56.720514 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:56.726110 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:56.726637 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:56.727435 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:56.727861 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:56.839032 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-db070f36-fc8e-4950-8a1e-e95cc40a0356 req-7802c2ea-7255-42c6-b55c-3471acb815f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a8ad671-d695-4901-8858-951d2ded8936", "tag": "49983887-538f-4bc4-89a4-9b8d01ca1847"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:56.841718 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:56.841718 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:33:56.849280 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-db070f36-fc8e-4950-8a1e-e95cc40a0356 req-7802c2ea-7255-42c6-b55c-3471acb815f0 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:56.850135 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-db070f36-fc8e-4950-8a1e-e95cc40a0356 req-7802c2ea-7255-42c6-b55c-3471acb815f0 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:56.862329 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-db070f36-fc8e-4950-8a1e-e95cc40a0356 req-7802c2ea-7255-42c6-b55c-3471acb815f0 service nova] Creating event network-changed:49983887-538f-4bc4-89a4-9b8d01ca1847 for instance 4a8ad671-d695-4901-8858-951d2ded8936 on hv-cinder-78956 Aug 04 16:33:56.865383 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:56.869019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-db070f36-fc8e-4950-8a1e-e95cc40a0356 req-7802c2ea-7255-42c6-b55c-3471acb815f0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033803 Aug 04 16:33:56.869922 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 528/1064] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:33:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:56.873328 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-43519b2c-3ab7-4c95-a2dc-4fc42b4b4c2c tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1319 microversion: 2.1 time: 0.158586 Aug 04 16:33:56.873979 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 537/1065] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:56 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:57.891202 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:57.891916 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:57.898699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:57.899148 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:57.899909 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:57.900334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:58.035224 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:58.042634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-785a8094-8d20-4c06-9fd6-705389096145 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1319 microversion: 2.1 time: 0.155596 Aug 04 16:33:58.043203 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 529/1066] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:57 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:59.060392 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:59.061032 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:33:59.067631 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:59.068073 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:59.068813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:33:59.069614 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:33:59.351702 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:59.359206 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d7f63dd5-426b-411e-97d9-82dcfb440294 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1319 microversion: 2.1 time: 0.302912 Aug 04 16:33:59.359803 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 538/1067] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:33:59 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:00.376480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.377094 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:00.383602 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:00.384051 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:00.384843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:00.385276 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:00.510765 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:00.519346 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-3cd54fc9-f98f-4589-8a2d-6bc48bb40216 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1319 microversion: 2.1 time: 0.146651 Aug 04 16:34:00.519918 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 530/1068] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:34:00 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:01.500936 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-ce29da76-35df-41f7-9a9d-559bb843330b req-5ad374bb-b193-4814-81cf-34b7a80034c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8ad671-d695-4901-8858-951d2ded8936", "name": "network-vif-plugged", "status": "completed", "tag": "49983887-538f-4bc4-89a4-9b8d01ca1847"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:01.502461 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:01.502461 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:34:01.510776 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-ce29da76-35df-41f7-9a9d-559bb843330b req-5ad374bb-b193-4814-81cf-34b7a80034c5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:01.511216 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-ce29da76-35df-41f7-9a9d-559bb843330b req-5ad374bb-b193-4814-81cf-34b7a80034c5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:01.524812 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-ce29da76-35df-41f7-9a9d-559bb843330b req-5ad374bb-b193-4814-81cf-34b7a80034c5 service nova] Creating event network-vif-plugged:49983887-538f-4bc4-89a4-9b8d01ca1847 for instance 4a8ad671-d695-4901-8858-951d2ded8936 on hv-cinder-78956 Aug 04 16:34:01.530455 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-ce29da76-35df-41f7-9a9d-559bb843330b req-5ad374bb-b193-4814-81cf-34b7a80034c5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033765 Aug 04 16:34:01.531426 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 539/1069] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:34:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:01.540699 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.541458 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:01.548293 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:01.549371 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:01.550236 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:01.550661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:01.693147 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:01.701763 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fce7a8eb-ede2-43b8-b1db-7020543da11f tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1319 microversion: 2.1 time: 0.169084 Aug 04 16:34:01.702438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 531/1070] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:34:01 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:02.720548 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:02.721350 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:02.728308 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:02.729108 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:02.729895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:02.730352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:02.865503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:02.875914 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-75d5b0aa-2b27-497e-90e4-8c37bb5eb85d tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1508 microversion: 2.1 time: 0.160298 Aug 04 16:34:02.876541 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 540/1071] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:34:02 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:02.892484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9208bdfc-d448-418d-81b0-66728ec47adf tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1b235d2-c4f4-4da0-908c-6123d0f7c879", "device": "/dev/sdb"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:02.893570 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9208bdfc-d448-418d-81b0-66728ec47adf tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:02.900387 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9208bdfc-d448-418d-81b0-66728ec47adf tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:02.900829 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9208bdfc-d448-418d-81b0-66728ec47adf tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:02.901639 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9208bdfc-d448-418d-81b0-66728ec47adf tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:02.902127 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9208bdfc-d448-418d-81b0-66728ec47adf tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:03.265930 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9208bdfc-d448-418d-81b0-66728ec47adf tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "POST /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377224 Aug 04 16:34:03.266489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 532/1072] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 4 16:34:02 2021] POST /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:17.402835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:34:17.403610 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:34:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:34:21.565862 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:21.566493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:21.573185 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:21.573624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:21.574453 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:21.574895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:21.667052 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lazy-loading 'services' on Instance uuid 4a8ad671-d695-4901-8858-951d2ded8936 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:34:21.734686 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-dfad6908-b14d-44a1-be6e-eb2978910725 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936/os-volume_attachments/d1b235d2-c4f4-4da0-908c-6123d0f7c879" status: 202 len: 0 microversion: 2.1 time: 0.172394 Aug 04 16:34:21.735298 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 541/1073] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 4 16:34:21 2021] DELETE /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936/os-volume_attachments/d1b235d2-c4f4-4da0-908c-6123d0f7c879 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:34:22.857363 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:22.858144 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:22.871836 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:22.872315 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:22.873099 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:22.873531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:22.899410 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:34:22.989251 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-59274756-c3bf-44ee-a0cf-1e94202c6212 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 204 len: 0 microversion: 2.1 time: 0.136097 Aug 04 16:34:22.989788 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 533/1074] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:34:22 2021] DELETE /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:34:23.003526 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:23.004784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:23.015999 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:23.016758 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:23.018175 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:23.018938 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:23.158578 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:23.167473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0f25f612-4748-4b9a-b75c-7541b8673f62 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1514 microversion: 2.1 time: 0.171918 Aug 04 16:34:23.170272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 542/1075] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:34:22 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:24.187790 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:24.188480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:24.195741 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:24.196190 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:24.196967 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:24.197399 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:24.329908 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:24.337912 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-1f0a7ad3-837e-44b7-a811-708cbdce13e5 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1514 microversion: 2.1 time: 0.155019 Aug 04 16:34:24.338534 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 534/1076] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:34:24 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:25.356006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:25.356876 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:25.372063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:25.372872 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:25.373645 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:25.374270 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:25.394732 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-d3bc0fed-7707-4643-936f-c7c5695a0566 req-84bfcaf9-016c-4a26-910d-749bf26649fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8ad671-d695-4901-8858-951d2ded8936", "name": "network-vif-deleted", "tag": "49983887-538f-4bc4-89a4-9b8d01ca1847"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:25.397765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:25.397765 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:34:25.405731 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-d3bc0fed-7707-4643-936f-c7c5695a0566 req-84bfcaf9-016c-4a26-910d-749bf26649fe service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:25.406210 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-d3bc0fed-7707-4643-936f-c7c5695a0566 req-84bfcaf9-016c-4a26-910d-749bf26649fe service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:25.418290 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-d3bc0fed-7707-4643-936f-c7c5695a0566 req-84bfcaf9-016c-4a26-910d-749bf26649fe service nova] Creating event network-vif-deleted:49983887-538f-4bc4-89a4-9b8d01ca1847 for instance 4a8ad671-d695-4901-8858-951d2ded8936 on hv-cinder-78956 Aug 04 16:34:25.424211 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-d3bc0fed-7707-4643-936f-c7c5695a0566 req-84bfcaf9-016c-4a26-910d-749bf26649fe service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109103 Aug 04 16:34:25.425109 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 543/1077] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:25.442632 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ca07ad0e944763baea070ca0f12177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166850251ba549a2b5a7b0058be05b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:25.451211 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-97794b41-ed92-479b-b2ba-fdeaa817a715 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 200 len: 1304 microversion: 2.1 time: 0.099193 Aug 04 16:34:25.452161 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 535/1078] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:34:25 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:26.471189 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:26.471924 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] [instance: 4a8ad671-d695-4901-8858-951d2ded8936] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:34:26.478585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:26.479045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:26.479881 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:34:26.480227 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:34:26.494209 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] HTTP exception thrown: Instance 4a8ad671-d695-4901-8858-951d2ded8936 could not be found. Aug 04 16:34:26.494802 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] Returning 404 to user: Instance 4a8ad671-d695-4901-8858-951d2ded8936 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:34:26.495620 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-be78338c-8049-46fc-8487-2d69e23f1b11 tempest-VolumesSnapshotTestJSON-647449855 tempest-VolumesSnapshotTestJSON-647449855-project] 10.222.0.77 "GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936" status: 404 len: 111 microversion: 2.1 time: 0.029523 Aug 04 16:34:26.496171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 544/1079] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:34:26 2021] GET /compute/v2.1/servers/4a8ad671-d695-4901-8858-951d2ded8936 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:01.105534 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-433d5407-5274-4663-89a7-934cbbfb936e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Action: 'create', calling method: .version_select at 0x7f2718219b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1339503199"}} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:01.125014 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-433d5407-5274-4663-89a7-934cbbfb936e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:35:01.129132 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-433d5407-5274-4663-89a7-934cbbfb936e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for user 42938fd921404e889c0c61bd12416567 and project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:35:01.506778 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-433d5407-5274-4663-89a7-934cbbfb936e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:35:01.511260 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.quota [None req-433d5407-5274-4663-89a7-934cbbfb936e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for user 42938fd921404e889c0c61bd12416567 and project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'key_pairs'} {{(pid=107558) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:35:01.527576 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-433d5407-5274-4663-89a7-934cbbfb936e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.599045 Aug 04 16:35:01.528412 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 536/1080] 10.222.0.77 () {60 vars in 1158 bytes} [Wed Aug 4 16:35:00 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:20.155752 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1021743803", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1339503199", "security_groups": [{"name": "tempest-secgroup-smoke-280391544"}], "block_device_mapping_v2": [{"uuid": "cbbddb8f-03db-4a50-b79f-e0a2c4519691", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59866ae8-539a-474f-89c4-65ac0d0e67ca"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:20.266766 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] validate_networks() for [('59866ae8-539a-474f-89c4-65ac0d0e67ca', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:35:20.688226 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:35:20.688643 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:35:20.689119 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:35:20.689545 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:35:20.689996 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:35:20.699538 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:20.699976 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:20.700739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:20.701163 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:20.717445 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:35:20.721551 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for user 42938fd921404e889c0c61bd12416567 and project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:35:20.784066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:35:20.786226 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbbddb8f-03db-4a50-b79f-e0a2c4519691',volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:35:20.916490 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [d820fe63-3e03-47a7-8700-68b2ab470d1a] AMQP server on 10.222.0.77:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 16:35:21.933880 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [d820fe63-3e03-47a7-8700-68b2ab470d1a] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 56986. Aug 04 16:35:21.938114 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-82e988d2-9a2d-48e0-86c0-10b8d79be958 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.786277 Aug 04 16:35:21.938879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 545/1081] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:35:20 2021] POST /compute/v2.1/servers => generated 405 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:35:21.950269 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cb84ec6e-8978-4660-a003-b57d6831c384 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:21.950910 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cb84ec6e-8978-4660-a003-b57d6831c384 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:22.005092 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cb84ec6e-8978-4660-a003-b57d6831c384 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:22.013006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cb84ec6e-8978-4660-a003-b57d6831c384 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1095 microversion: 2.1 time: 0.067198 Aug 04 16:35:22.013771 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 537/1082] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:21 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:23.030338 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:23.030970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:23.038250 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:23.038688 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:23.039488 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:23.039911 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:23.108169 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:23.116208 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-a369b39b-f890-42aa-9de0-46fa258de43b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1193 microversion: 2.1 time: 0.089736 Aug 04 16:35:23.116797 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 546/1083] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:23 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:24.133556 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:24.134215 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:24.140480 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:24.140966 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:24.141761 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:24.142224 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:24.666879 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:24.677162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c848ee1a-f186-44c3-a81d-f87c125008cc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.547342 Aug 04 16:35:24.681688 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 538/1084] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:24 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:25.030705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-51422023-f67e-47fc-ae43-bc7ea2fa4327 req-f4f22a8c-cf9b-4e1b-a75a-ae4cd5075c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbec4d72-541d-4f20-a404-fb3a26c35f59", "tag": "0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:25.032363 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:25.032363 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:35:25.040573 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-51422023-f67e-47fc-ae43-bc7ea2fa4327 req-f4f22a8c-cf9b-4e1b-a75a-ae4cd5075c6d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:25.041039 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-51422023-f67e-47fc-ae43-bc7ea2fa4327 req-f4f22a8c-cf9b-4e1b-a75a-ae4cd5075c6d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:25.054276 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-51422023-f67e-47fc-ae43-bc7ea2fa4327 req-f4f22a8c-cf9b-4e1b-a75a-ae4cd5075c6d service nova] Creating event network-changed:0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0 for instance dbec4d72-541d-4f20-a404-fb3a26c35f59 on hv-cinder-78956 Aug 04 16:35:25.060394 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-51422023-f67e-47fc-ae43-bc7ea2fa4327 req-f4f22a8c-cf9b-4e1b-a75a-ae4cd5075c6d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033790 Aug 04 16:35:25.061159 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 547/1085] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:35:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:25.695593 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:25.696565 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:25.704677 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:25.705334 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:25.706724 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:25.707417 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:25.943489 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:25.952142 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-31629f26-e269-4a8f-a37a-75a7a1e335c8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.261883 Aug 04 16:35:25.952720 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 539/1086] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:25 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:26.976973 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:26.977689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:26.985429 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:26.985879 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:26.987088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:26.987569 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:27.133722 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:27.147643 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-560998e9-626b-4164-9cdb-685d64d91970 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.174660 Aug 04 16:35:27.148708 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 548/1087] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:26 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:28.175212 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:28.176520 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:28.187936 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:28.188756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:28.190255 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:28.191288 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:28.346165 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:28.354270 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-fa037a1c-c6bd-402a-bf39-6ba3fc06933e tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.185514 Aug 04 16:35:28.354859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 540/1088] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:28 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:29.371513 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:29.372138 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:29.378966 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:29.379417 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:29.380204 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:29.380633 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:29.536600 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:29.544611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8a68480f-1d8c-4ffc-8498-350bd02ba8cd tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.176779 Aug 04 16:35:29.545199 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 549/1089] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:29 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:30.568944 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:30.569569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:30.576496 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:30.576944 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:30.577727 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:30.578271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:30.714115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:30.721931 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4575663e-02b6-4614-924a-12591b9ef352 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.157840 Aug 04 16:35:30.722532 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 541/1090] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:30 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:31.739038 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:31.739682 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:31.746372 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:31.746821 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:31.747614 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:31.748043 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:31.868992 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:31.876808 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-017314cc-8452-469a-a685-c6c6a0c9c081 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.141753 Aug 04 16:35:31.877527 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 550/1091] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:31 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:32.894540 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:32.894540 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:32.901019 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:32.901561 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:32.902379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:32.902843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:33.054611 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:33.062180 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5a62a337-074f-4f18-a6db-a0ca2201e703 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.172625 Aug 04 16:35:33.062759 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 542/1092] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:32 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:34.080335 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:34.080970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:34.087513 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:34.087964 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:34.088785 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:34.089242 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:34.218640 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:34.226656 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-fdcdd8b6-c152-4be3-8cb7-2db9498024e0 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.150115 Aug 04 16:35:34.227237 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 551/1093] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:34 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:35.243597 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:35.244232 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:35.251012 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:35.251491 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:35.252322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:35.253097 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:35.396501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:35.404749 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-67847de3-ef09-47fe-8546-3804bcf06fb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.164810 Aug 04 16:35:35.405343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 543/1094] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:35 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:36.037496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-aee1bb18-4083-4dc7-bc2d-ecd0b40e78ff req-6d5caae5-1fcb-4679-a4c2-4dde034c49b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbec4d72-541d-4f20-a404-fb3a26c35f59", "name": "network-vif-plugged", "status": "completed", "tag": "0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:36.039668 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:36.039668 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:35:36.047093 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-aee1bb18-4083-4dc7-bc2d-ecd0b40e78ff req-6d5caae5-1fcb-4679-a4c2-4dde034c49b4 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:36.047532 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-aee1bb18-4083-4dc7-bc2d-ecd0b40e78ff req-6d5caae5-1fcb-4679-a4c2-4dde034c49b4 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:36.059014 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-aee1bb18-4083-4dc7-bc2d-ecd0b40e78ff req-6d5caae5-1fcb-4679-a4c2-4dde034c49b4 service nova] Creating event network-vif-plugged:0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0 for instance dbec4d72-541d-4f20-a404-fb3a26c35f59 on hv-cinder-78956 Aug 04 16:35:36.063947 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-aee1bb18-4083-4dc7-bc2d-ecd0b40e78ff req-6d5caae5-1fcb-4679-a4c2-4dde034c49b4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089355 Aug 04 16:35:36.064535 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 552/1095] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:35:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:36.422291 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:36.422899 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:36.430200 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:36.430656 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:36.431467 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:36.431901 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:36.581547 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:36.589432 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c91cf157-79f5-4654-bf0e-397232ff7a33 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1266 microversion: 2.1 time: 0.170885 Aug 04 16:35:36.590063 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 544/1096] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:36 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:37.608181 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:37.608889 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:37.618380 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:37.618828 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:37.619813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:37.620582 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:37.769104 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:37.777479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b742a1af-c987-44ae-bfbe-906aae798f90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1453 microversion: 2.1 time: 0.174178 Aug 04 16:35:37.778100 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 553/1097] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:37 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:37.798354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:37.799240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:35:37.806011 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:37.806445 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:37.807225 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:37.807715 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:37.943714 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:37.952478 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8e3604ff-a4f4-478b-b0b1-fcdd78b29325 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1453 microversion: 2.1 time: 0.157460 Aug 04 16:35:37.953291 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 545/1098] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:35:37 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:40.152306 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-0accae6b-f604-4d4a-8459-7ee3b02ace10 req-dd5c2ac4-66c4-43a0-8ee6-be6000e84116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbec4d72-541d-4f20-a404-fb3a26c35f59", "tag": "0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:40.153821 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:40.153821 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:35:40.161499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-0accae6b-f604-4d4a-8459-7ee3b02ace10 req-dd5c2ac4-66c4-43a0-8ee6-be6000e84116 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:35:40.161914 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-0accae6b-f604-4d4a-8459-7ee3b02ace10 req-dd5c2ac4-66c4-43a0-8ee6-be6000e84116 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:35:40.179983 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-0accae6b-f604-4d4a-8459-7ee3b02ace10 req-dd5c2ac4-66c4-43a0-8ee6-be6000e84116 service nova] Creating event network-changed:0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0 for instance dbec4d72-541d-4f20-a404-fb3a26c35f59 on hv-cinder-78956 Aug 04 16:35:40.188493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-0accae6b-f604-4d4a-8459-7ee3b02ace10 req-dd5c2ac4-66c4-43a0-8ee6-be6000e84116 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099232 Aug 04 16:35:40.189569 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 554/1099] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:35:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:59.361493 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:35:59.362340 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: Wed Aug 4 16:35:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:37:37.423447 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:37:37.424388 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:37:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:37:37.946341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:37.946756 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:37.953386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:37.953817 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:37.954642 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:37.955065 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:37.988942 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Going to try to terminate instance {{(pid=107558) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:37:38.079140 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-620a4907-8720-4a7f-a842-3abae6b7514f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "DELETE /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 204 len: 0 microversion: 2.1 time: 0.139719 Aug 04 16:37:38.080543 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 546/1100] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:37:37 2021] DELETE /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:37:38.090278 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 16:37:38.097012 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:38.098377 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:38.109045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:38.109841 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:38.111297 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:38.112066 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:38.280775 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:38.289674 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-8c6e22ac-2051-4039-b89d-ae331f579aac tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1577 microversion: 2.1 time: 0.202968 Aug 04 16:37:38.290280 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 555/1101] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:38 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:39.312352 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:39.313622 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:39.324328 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:39.324806 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:39.325647 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:39.326115 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:39.492300 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:39.501224 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6c01641e-5122-44ae-b2a4-91d07fa27edc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1577 microversion: 2.1 time: 0.196275 Aug 04 16:37:39.501916 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 547/1102] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:39 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:40.522971 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:40.523886 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:40.555895 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:40.556553 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:40.557753 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:40.558457 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:40.586838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 57096. Aug 04 16:37:40.731408 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:40.740906 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-22a3a4bd-cfcf-4fe5-9c38-09efa6212af6 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1577 microversion: 2.1 time: 0.224834 Aug 04 16:37:40.741746 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 556/1103] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:40 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:41.038627 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-2840762a-4d42-4c53-bc43-374528166e78 req-81f6ba7b-982a-46a5-ba7e-edf42489bded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbec4d72-541d-4f20-a404-fb3a26c35f59", "name": "network-vif-deleted", "tag": "0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:41.041149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:37:41.041149 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:37:41.051654 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-2840762a-4d42-4c53-bc43-374528166e78 req-81f6ba7b-982a-46a5-ba7e-edf42489bded service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:41.052725 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-2840762a-4d42-4c53-bc43-374528166e78 req-81f6ba7b-982a-46a5-ba7e-edf42489bded service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:41.066536 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-2840762a-4d42-4c53-bc43-374528166e78 req-81f6ba7b-982a-46a5-ba7e-edf42489bded service nova] Creating event network-vif-deleted:0b1a0a60-10ed-447d-b4e9-74c4d6c2d2e0 for instance dbec4d72-541d-4f20-a404-fb3a26c35f59 on hv-cinder-78956 Aug 04 16:37:41.073237 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-2840762a-4d42-4c53-bc43-374528166e78 req-81f6ba7b-982a-46a5-ba7e-edf42489bded service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041949 Aug 04 16:37:41.074000 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 548/1104] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:37:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:41.764198 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:41.765356 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:41.775846 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:41.776585 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:41.777920 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:41.778970 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:41.833372 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:41.833836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:41.834424 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.objects.instance [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lazy-loading 'fault' on Instance uuid dbec4d72-541d-4f20-a404-fb3a26c35f59 {{(pid=107559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:41.883123 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:41.896503 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c328736d-7417-4960-af54-714f0fc46b28 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 200 len: 1231 microversion: 2.1 time: 0.140423 Aug 04 16:37:41.897758 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 557/1105] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:41 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 1231 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:42.922848 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:42.923681 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:42.932671 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:42.933148 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:42.934437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:42.935138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:42.954426 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] HTTP exception thrown: Instance dbec4d72-541d-4f20-a404-fb3a26c35f59 could not be found. Aug 04 16:37:42.955029 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Returning 404 to user: Instance dbec4d72-541d-4f20-a404-fb3a26c35f59 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:37:42.955869 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b361d067-26e0-414c-a69e-eba4f8c9980c tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 404 len: 111 microversion: 2.1 time: 0.038440 Aug 04 16:37:42.956450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 549/1106] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:42 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:37:43.071596 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-106740102", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1339503199", "security_groups": [{"name": "tempest-secgroup-smoke-280391544"}], "block_device_mapping_v2": [{"uuid": "cbbddb8f-03db-4a50-b79f-e0a2c4519691", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59866ae8-539a-474f-89c4-65ac0d0e67ca"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:43.232164 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] validate_networks() for [('59866ae8-539a-474f-89c4-65ac0d0e67ca', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:37:43.687505 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:37:43.688024 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:37:43.688500 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:37:43.689101 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:37:43.689324 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:37:43.699366 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:43.699806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:43.700611 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:43.701045 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:43.720438 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:37:43.725171 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for user 42938fd921404e889c0c61bd12416567 and project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:37:43.789483 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:37:43.791666 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbbddb8f-03db-4a50-b79f-e0a2c4519691',volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:37:43.922776 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-7ac4a2ca-fd4e-444e-b7fc-e3d7dbfbc35a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.856847 Aug 04 16:37:43.923431 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 558/1107] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:37:43 2021] POST /compute/v2.1/servers => generated 405 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:37:43.935079 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b29b55c0-0eba-48b8-8d0f-b468eb92f37d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:43.936478 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b29b55c0-0eba-48b8-8d0f-b468eb92f37d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:43.994126 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b29b55c0-0eba-48b8-8d0f-b468eb92f37d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:44.001277 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b29b55c0-0eba-48b8-8d0f-b468eb92f37d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1094 microversion: 2.1 time: 0.071426 Aug 04 16:37:44.001882 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 550/1108] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:43 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:45.020659 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:45.022065 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:45.030001 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:45.030610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:45.031689 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:45.032518 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:45.132333 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:45.143251 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-834ea7cf-f9ff-4a49-bbc1-2bb659d4b072 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1200 microversion: 2.1 time: 0.127673 Aug 04 16:37:45.144005 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 559/1109] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:45 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1200 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:46.173531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:46.174392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:46.177381 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0a3e30e-7a55-4740-a186-1b6a0cde96a2] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 16:37:46.184041 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:46.184484 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:46.185528 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:46.185774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:46.679717 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:46.688081 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-92db69d3-9530-4c6d-bd73-2fa10e8ff275 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.518951 Aug 04 16:37:46.688656 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 551/1110] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:46 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:46.996110 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-a977c646-3fc6-4dfb-a332-ebfb8ad7115c req-c5bfd651-f4a3-49c7-a8d1-495cd0bcc5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1858d6-4e4d-4011-97bb-27f7ef6230b5", "tag": "9df42b81-6500-4efa-88e9-1809026e2d87"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:46.998499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:37:46.998499 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:37:47.007329 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-a977c646-3fc6-4dfb-a332-ebfb8ad7115c req-c5bfd651-f4a3-49c7-a8d1-495cd0bcc5c5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:47.007670 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-a977c646-3fc6-4dfb-a332-ebfb8ad7115c req-c5bfd651-f4a3-49c7-a8d1-495cd0bcc5c5 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:47.019667 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-a977c646-3fc6-4dfb-a332-ebfb8ad7115c req-c5bfd651-f4a3-49c7-a8d1-495cd0bcc5c5 service nova] Creating event network-changed:9df42b81-6500-4efa-88e9-1809026e2d87 for instance cf1858d6-4e4d-4011-97bb-27f7ef6230b5 on hv-cinder-78956 Aug 04 16:37:47.025796 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-a977c646-3fc6-4dfb-a332-ebfb8ad7115c req-c5bfd651-f4a3-49c7-a8d1-495cd0bcc5c5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033325 Aug 04 16:37:47.026806 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 560/1111] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:37:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:47.706692 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:47.707847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:47.724893 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:47.725343 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:47.726193 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:47.726624 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:47.733271 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0a3e30e-7a55-4740-a186-1b6a0cde96a2] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 57140. Aug 04 16:37:47.944006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:47.952017 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-4c6e9d96-7a8d-4355-99a5-860134b25647 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.249238 Aug 04 16:37:47.952635 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 552/1112] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:47 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:48.969693 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:48.970470 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:48.977479 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:48.977972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:48.978800 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:48.979232 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:49.114074 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:49.122270 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-92e0bbb0-e798-462a-a2c5-44cfd7a23cc4 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.156853 Aug 04 16:37:49.122861 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 561/1113] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:48 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:50.139433 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:50.140253 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:50.147322 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:50.147766 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:50.148552 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:50.148980 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:50.286361 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:50.294433 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cdfc6ec0-8826-4100-ad62-03d212cfffb3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.158645 Aug 04 16:37:50.295052 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 553/1114] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:50 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:51.311898 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:51.312537 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:51.319623 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:51.320072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:51.320942 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:51.321291 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:51.452474 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:51.461013 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-f14210a2-4f80-4ef5-94f9-e4bfb75a96d8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.152783 Aug 04 16:37:51.461694 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 562/1115] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:51 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:52.479419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:52.479419 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:52.485398 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:52.485817 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:52.486620 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:52.487047 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:52.615673 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:52.623661 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-68420846-a477-4419-93d6-cb69e1ec5039 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.148847 Aug 04 16:37:52.624603 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 554/1116] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:52 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:53.641349 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:53.641981 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:53.648915 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:53.649364 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:53.650182 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:53.650617 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:53.778324 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:53.786352 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-76f14aba-a7eb-4f91-926b-8a4745bda6fe tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.148736 Aug 04 16:37:53.786922 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 563/1117] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:53 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:54.803216 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:54.803856 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:54.810696 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:54.811138 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:54.811920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:54.812379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:54.940246 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:54.948240 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-58311f50-571f-498e-a43c-7699da2e7293 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.148700 Aug 04 16:37:54.948820 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 555/1118] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:54 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:55.966612 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:55.967160 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:55.974020 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:55.974478 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:55.975259 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:55.975712 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:56.102102 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:56.119836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-46bc3bbe-248a-4f0d-89f1-4e4ba7110a37 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.157090 Aug 04 16:37:56.120428 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 564/1119] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:55 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:56.740469 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-4ec56bcd-b138-47c1-8faf-920187966155 req-6f8d6939-ee75-4805-be76-a64405962d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1858d6-4e4d-4011-97bb-27f7ef6230b5", "name": "network-vif-plugged", "status": "completed", "tag": "9df42b81-6500-4efa-88e9-1809026e2d87"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:56.742176 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:37:56.742176 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:37:56.750633 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-4ec56bcd-b138-47c1-8faf-920187966155 req-6f8d6939-ee75-4805-be76-a64405962d4d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:56.751158 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-4ec56bcd-b138-47c1-8faf-920187966155 req-6f8d6939-ee75-4805-be76-a64405962d4d service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:56.764096 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-4ec56bcd-b138-47c1-8faf-920187966155 req-6f8d6939-ee75-4805-be76-a64405962d4d service nova] Creating event network-vif-plugged:9df42b81-6500-4efa-88e9-1809026e2d87 for instance cf1858d6-4e4d-4011-97bb-27f7ef6230b5 on hv-cinder-78956 Aug 04 16:37:56.769309 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-4ec56bcd-b138-47c1-8faf-920187966155 req-6f8d6939-ee75-4805-be76-a64405962d4d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032534 Aug 04 16:37:56.770283 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 556/1120] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:37:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:57.137123 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:57.137699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:57.144484 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:57.144957 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:57.145779 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:57.146248 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:57.271464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:57.280004 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-b1268c6e-501b-4daa-90f4-f0320b9a3779 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1265 microversion: 2.1 time: 0.146499 Aug 04 16:37:57.280581 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 565/1121] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:57 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:58.297745 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:58.298450 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:58.305438 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:58.305886 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:58.306693 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:58.307123 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:58.435876 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:58.443979 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-22278bc1-af82-4201-8634-6da63ae98a57 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1452 microversion: 2.1 time: 0.150300 Aug 04 16:37:58.444531 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 557/1122] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:58 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:58.460486 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:58.461083 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:37:58.467396 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:58.467836 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:58.468608 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:37:58.469041 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:37:58.605464 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:58.613827 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c336b5c1-d92f-4790-bb35-addf08b17fd8 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1452 microversion: 2.1 time: 0.157362 Aug 04 16:37:58.614460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 566/1123] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:37:58 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:00.338382 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-006ec434-5b0b-47ff-ac20-265850866a00 req-d89743a3-2eb4-4a3e-b9c8-81a17748e3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1858d6-4e4d-4011-97bb-27f7ef6230b5", "tag": "9df42b81-6500-4efa-88e9-1809026e2d87"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:00.339874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:38:00.339874 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:38:00.346861 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-006ec434-5b0b-47ff-ac20-265850866a00 req-d89743a3-2eb4-4a3e-b9c8-81a17748e3c2 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:38:00.347455 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-006ec434-5b0b-47ff-ac20-265850866a00 req-d89743a3-2eb4-4a3e-b9c8-81a17748e3c2 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:38:00.359729 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-006ec434-5b0b-47ff-ac20-265850866a00 req-d89743a3-2eb4-4a3e-b9c8-81a17748e3c2 service nova] Creating event network-changed:9df42b81-6500-4efa-88e9-1809026e2d87 for instance cf1858d6-4e4d-4011-97bb-27f7ef6230b5 on hv-cinder-78956 Aug 04 16:38:00.364655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-006ec434-5b0b-47ff-ac20-265850866a00 req-d89743a3-2eb4-4a3e-b9c8-81a17748e3c2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029803 Aug 04 16:38:00.365488 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 558/1124] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:38:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:00.169501 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:39:00.170336 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:39:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:39:19.381111 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:39:19.381775 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: Wed Aug 4 16:39:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:39:45.738361 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1825464041", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1339503199", "security_groups": [{"name": "tempest-secgroup-smoke-280391544"}], "block_device_mapping_v2": [{"uuid": "c8d2d180-414b-4004-ad7b-ef8b133c10cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59866ae8-539a-474f-89c4-65ac0d0e67ca"}]}} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:46.027247 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.network.neutron [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] validate_networks() for [('59866ae8-539a-474f-89c4-65ac0d0e67ca', None, None, None)] {{(pid=107559) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 16:39:46.527736 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Flavor limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:39:46.528166 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Image limits 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:39:46.528639 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Flavor pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:39:46.529079 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Image pref 0:0:0 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:39:46.529519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.virt.hardware [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:39:46.540219 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:46.540823 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:46.541868 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:46.542423 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:46.561838 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 16:39:46.566699 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.quota [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Getting quotas for user 42938fd921404e889c0c61bd12416567 and project 06f80bf601104261bec5af98cd6a9bc5. Resources: {'instances', 'cores', 'ram'} {{(pid=107559) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 16:39:46.634519 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Going to run 1 instances... {{(pid=107559) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 16:39:46.636640 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8d2d180-414b-4004-ad7b-ef8b133c10cc',volume_size=None,volume_type=None)] {{(pid=107559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 16:39:46.768859 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d928f361-1868-4c1e-8b2f-8a645037306a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.035238 Aug 04 16:39:46.775185 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 567/1125] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 4 16:39:45 2021] POST /compute/v2.1/servers => generated 405 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:39:46.783774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e82dcb36-9050-4357-8edc-96fef644dd21 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:46.783774 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e82dcb36-9050-4357-8edc-96fef644dd21 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:46.909594 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e82dcb36-9050-4357-8edc-96fef644dd21 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:46.917233 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e82dcb36-9050-4357-8edc-96fef644dd21 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1095 microversion: 2.1 time: 0.140633 Aug 04 16:39:46.917816 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 559/1126] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:46 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1095 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:39:47.936875 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:47.937705 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:47.946772 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:47.947473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:47.948452 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:47.949097 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:48.025098 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:48.033548 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-409bfdf1-bcb4-4e81-a0b4-81674a52c420 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1211 microversion: 2.1 time: 0.101643 Aug 04 16:39:48.034339 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 568/1127] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:47 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:49.056861 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:49.057981 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:49.070114 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:49.070904 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:49.072341 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:49.073113 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:49.339833 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:49.354392 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e89d6e7b-95bb-40ab-a8fa-8c736d3db62d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.303222 Aug 04 16:39:49.355833 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 560/1128] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:49 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:49.644147 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-9a57967f-4964-44e3-9e82-203841961ee1 req-4c2eab21-917c-4282-a989-5d48e7846750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5ddc45-80ad-4cf1-b09b-0a8d274edd42", "tag": "ce05f0a3-2b79-46b0-be4c-371b328ff3d9"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:49.645972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:39:49.645972 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:39:49.654090 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-9a57967f-4964-44e3-9e82-203841961ee1 req-4c2eab21-917c-4282-a989-5d48e7846750 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:49.654598 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-9a57967f-4964-44e3-9e82-203841961ee1 req-4c2eab21-917c-4282-a989-5d48e7846750 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:49.667564 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-9a57967f-4964-44e3-9e82-203841961ee1 req-4c2eab21-917c-4282-a989-5d48e7846750 service nova] Creating event network-changed:ce05f0a3-2b79-46b0-be4c-371b328ff3d9 for instance 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 on hv-cinder-78956 Aug 04 16:39:49.673088 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-9a57967f-4964-44e3-9e82-203841961ee1 req-4c2eab21-917c-4282-a989-5d48e7846750 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119307 Aug 04 16:39:49.674318 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 569/1129] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:50.374008 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:50.375292 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:50.382972 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:50.383578 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:50.384482 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:50.385006 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:50.597628 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:50.606013 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-8e4139c9-c98c-4e17-84ea-2f2cd6d2d520 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.236653 Aug 04 16:39:50.606621 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 561/1130] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:50 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:51.623856 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:51.624451 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:51.631151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:51.631604 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:51.632383 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:51.632819 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:51.760955 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:51.768870 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0b735588-a37e-4904-a764-ce29c2653557 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.149245 Aug 04 16:39:51.769497 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 570/1131] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:51 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:52.788001 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:52.788626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:52.795295 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:52.795747 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:52.796523 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:52.796946 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:52.925590 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:52.933987 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-cacd0ee2-6b40-45e9-8a81-520f5dba89a9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.149998 Aug 04 16:39:52.934626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 562/1132] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:52 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:53.951754 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:53.952339 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:53.959281 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:53.959727 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:53.960507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:53.961050 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:54.092062 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:54.100044 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-064e7e77-e075-41da-9c01-60b10a012ba9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.152031 Aug 04 16:39:54.100624 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 571/1133] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:53 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:55.117782 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:55.118452 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:55.124920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:55.125373 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:55.126191 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:55.126673 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:55.264024 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:55.274577 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-e973b91d-a8fb-42c5-9f5b-132261c991df tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.161042 Aug 04 16:39:55.275188 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 563/1134] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:55 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:56.292102 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:56.292745 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:56.299287 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:56.299739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:56.300527 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:56.300954 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:56.437507 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:56.446153 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-93ad0724-a876-4860-be9f-9d1d3be01f81 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.157943 Aug 04 16:39:56.446816 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 572/1135] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:56 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:57.468495 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:57.469120 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:57.475784 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:57.476280 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:57.477031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:57.477550 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:57.607693 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:57.615721 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-64c3facb-f4f9-4727-b56a-c9823e2a8af1 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.155171 Aug 04 16:39:57.616626 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 564/1136] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:57 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:58.633129 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:58.633736 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:58.640324 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:58.640775 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:58.641597 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:58.642070 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:58.777155 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:58.785228 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-0548fd50-02bb-4dbc-9fb0-a01674f8b08a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.156137 Aug 04 16:39:58.785831 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 573/1137] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:58 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:59.550691 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-321e3c59-5906-4264-af64-1b04b859ab01 req-2eaaf7d2-7580-4330-bbc3-e5ffcbed83aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5ddc45-80ad-4cf1-b09b-0a8d274edd42", "name": "network-vif-plugged", "status": "completed", "tag": "ce05f0a3-2b79-46b0-be4c-371b328ff3d9"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:59.552249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:39:59.552249 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:39:59.560160 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-321e3c59-5906-4264-af64-1b04b859ab01 req-2eaaf7d2-7580-4330-bbc3-e5ffcbed83aa service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:59.560738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-321e3c59-5906-4264-af64-1b04b859ab01 req-2eaaf7d2-7580-4330-bbc3-e5ffcbed83aa service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:59.573804 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-321e3c59-5906-4264-af64-1b04b859ab01 req-2eaaf7d2-7580-4330-bbc3-e5ffcbed83aa service nova] Creating event network-vif-plugged:ce05f0a3-2b79-46b0-be4c-371b328ff3d9 for instance 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 on hv-cinder-78956 Aug 04 16:39:59.579091 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-321e3c59-5906-4264-af64-1b04b859ab01 req-2eaaf7d2-7580-4330-bbc3-e5ffcbed83aa service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032145 Aug 04 16:39:59.579640 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 565/1138] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:59.802475 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:59.803846 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:39:59.810307 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:59.810757 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:59.813783 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:39:59.813783 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:39:59.946326 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:59.954909 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-c78dcb57-f296-4775-9989-44a0b3e85a5a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1266 microversion: 2.1 time: 0.156450 Aug 04 16:39:59.955504 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 574/1139] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:39:59 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:01.020344 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:01.021031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:40:01.027920 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:40:01.028379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:40:01.029141 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:40:01.029568 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:40:01.173753 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:01.181605 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-9b5ec7f0-f6c3-42f9-9ca8-4cae2ed5e5f7 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1454 microversion: 2.1 time: 0.212625 Aug 04 16:40:01.182207 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 566/1140] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:40:00 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1454 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:01.199355 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:01.199957 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:40:01.206739 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:40:01.207180 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:40:01.207976 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:40:01.208399 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:40:01.342496 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:01.351448 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-be50b396-38e3-40d8-8206-64243f35270b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1454 microversion: 2.1 time: 0.156525 Aug 04 16:40:01.352059 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 575/1141] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:40:01 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:03.564105 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-6c603616-21eb-4db4-8ff0-96a9db48a0e2 req-0bea8147-9083-4b57-ab7a-d4d527eebe55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5ddc45-80ad-4cf1-b09b-0a8d274edd42", "tag": "ce05f0a3-2b79-46b0-be4c-371b328ff3d9"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:03.566714 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:40:03.566714 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:40:03.574926 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-6c603616-21eb-4db4-8ff0-96a9db48a0e2 req-0bea8147-9083-4b57-ab7a-d4d527eebe55 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:40:03.575354 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-6c603616-21eb-4db4-8ff0-96a9db48a0e2 req-0bea8147-9083-4b57-ab7a-d4d527eebe55 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:40:03.587332 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-6c603616-21eb-4db4-8ff0-96a9db48a0e2 req-0bea8147-9083-4b57-ab7a-d4d527eebe55 service nova] Creating event network-changed:ce05f0a3-2b79-46b0-be4c-371b328ff3d9 for instance 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 on hv-cinder-78956 Aug 04 16:40:03.592929 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-6c603616-21eb-4db4-8ff0-96a9db48a0e2 req-0bea8147-9083-4b57-ab7a-d4d527eebe55 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032662 Aug 04 16:40:03.593843 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 567/1142] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:57.456273 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:40:57.457016 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:40:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:41:43.587364 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 16:41:43.591215 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:43.591793 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:43.602460 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:43.603316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:43.604398 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:43.605072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:43.658864 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:41:43.659208 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-3e2cbfe3-88f1-4f38-a556-3e42f36cfd8b req-f1ddd32a-0e87-4c16-bce2-42a849fd983e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5ddc45-80ad-4cf1-b09b-0a8d274edd42", "tag": "ce05f0a3-2b79-46b0-be4c-371b328ff3d9"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:43.660831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:41:43.660831 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:41:43.669785 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-3e2cbfe3-88f1-4f38-a556-3e42f36cfd8b req-f1ddd32a-0e87-4c16-bce2-42a849fd983e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:43.670323 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-3e2cbfe3-88f1-4f38-a556-3e42f36cfd8b req-f1ddd32a-0e87-4c16-bce2-42a849fd983e service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:43.687847 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-3e2cbfe3-88f1-4f38-a556-3e42f36cfd8b req-f1ddd32a-0e87-4c16-bce2-42a849fd983e service nova] Creating event network-changed:ce05f0a3-2b79-46b0-be4c-371b328ff3d9 for instance 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 on hv-cinder-78956 Aug 04 16:41:43.696437 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-3e2cbfe3-88f1-4f38-a556-3e42f36cfd8b req-f1ddd32a-0e87-4c16-bce2-42a849fd983e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108677 Aug 04 16:41:43.697552 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 568/1143] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:41:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:41:43.792118 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-405d7722-6b33-43ba-bea4-e237d696bbbc tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "DELETE /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 204 len: 0 microversion: 2.1 time: 0.206471 Aug 04 16:41:43.793912 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 576/1144] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:41:43 2021] DELETE /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:43.809221 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:43.810506 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:43.821162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:43.821914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:43.822863 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:43.823396 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:44.053152 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:44.062459 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-b63e8b7a-7fbc-4db7-9903-51abfb0a6a90 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1578 microversion: 2.1 time: 0.262222 Aug 04 16:41:44.063022 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 569/1145] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:43 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1578 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:45.084106 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:45.085065 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:45.107898 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] [ffdd16b0-fc79-4ffe-b434-709f4a9c0561] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 57370. Aug 04 16:41:45.112365 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:45.112830 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:45.113626 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:45.114099 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:45.257533 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:45.265627 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1db7776e-4569-47e5-bc83-345e3e46679a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1460 microversion: 2.1 time: 0.187041 Aug 04 16:41:45.266376 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 577/1146] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:45 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1460 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:46.286513 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:46.287738 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:46.298601 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:46.299418 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:46.300902 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:46.301701 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:46.514807 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:46.525434 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-5d2a0d12-1349-42d6-b72f-ff96fbf6096a tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 200 len: 1460 microversion: 2.1 time: 0.246143 Aug 04 16:41:46.526198 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 570/1147] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:46 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 1460 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:46.636225 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [req-58a5a184-0c30-4d71-9608-190728bb70f4 req-2b7cdc03-5901-4d4c-81e5-deb5a903417a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5ddc45-80ad-4cf1-b09b-0a8d274edd42", "name": "network-vif-deleted", "tag": "ce05f0a3-2b79-46b0-be4c-371b328ff3d9"}]} {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:46.639359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:41:46.639359 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: warnings.warn(msg) Aug 04 16:41:46.652184 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-58a5a184-0c30-4d71-9608-190728bb70f4 req-2b7cdc03-5901-4d4c-81e5-deb5a903417a service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:46.652959 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [req-58a5a184-0c30-4d71-9608-190728bb70f4 req-2b7cdc03-5901-4d4c-81e5-deb5a903417a service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:46.670007 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.compute.server_external_events [req-58a5a184-0c30-4d71-9608-190728bb70f4 req-2b7cdc03-5901-4d4c-81e5-deb5a903417a service nova] Creating event network-vif-deleted:ce05f0a3-2b79-46b0-be4c-371b328ff3d9 for instance 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 on hv-cinder-78956 Aug 04 16:41:46.675459 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [req-58a5a184-0c30-4d71-9608-190728bb70f4 req-2b7cdc03-5901-4d4c-81e5-deb5a903417a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046340 Aug 04 16:41:46.676277 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 578/1148] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:41:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:47.553020 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:47.553776 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:47.560562 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:47.560991 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:47.561803 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:47.562267 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:47.577359 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] HTTP exception thrown: Instance 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 could not be found. Aug 04 16:41:47.578031 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Returning 404 to user: Instance 6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:41:47.578824 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-6f4bfdf4-e387-4484-8ce0-8bb5f9c5325f tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42" status: 404 len: 111 microversion: 2.1 time: 0.029958 Aug 04 16:41:47.579395 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 571/1149] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:47 2021] GET /compute/v2.1/servers/6f5ddc45-80ad-4cf1-b09b-0a8d274edd42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:50.782164 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0a3e30e-7a55-4740-a186-1b6a0cde96a2] AMQP server on 10.222.0.77:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 04 16:41:50.786569 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-da3f5680-aad4-4ee9-9975-0dd895eb6e80 req-a1776ce0-f88a-4f45-bf3a-05722e8dc9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1858d6-4e4d-4011-97bb-27f7ef6230b5", "tag": "9df42b81-6500-4efa-88e9-1809026e2d87"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:50.788482 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:41:50.788482 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:41:50.796151 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:50.797075 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:50.799901 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-da3f5680-aad4-4ee9-9975-0dd895eb6e80 req-a1776ce0-f88a-4f45-bf3a-05722e8dc9ba service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:50.801066 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-da3f5680-aad4-4ee9-9975-0dd895eb6e80 req-a1776ce0-f88a-4f45-bf3a-05722e8dc9ba service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:50.806273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:50.807177 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:50.808610 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:50.809202 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:50.817336 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-da3f5680-aad4-4ee9-9975-0dd895eb6e80 req-a1776ce0-f88a-4f45-bf3a-05722e8dc9ba service nova] Creating event network-changed:9df42b81-6500-4efa-88e9-1809026e2d87 for instance cf1858d6-4e4d-4011-97bb-27f7ef6230b5 on hv-cinder-78956 Aug 04 16:41:50.823827 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-da3f5680-aad4-4ee9-9975-0dd895eb6e80 req-a1776ce0-f88a-4f45-bf3a-05722e8dc9ba service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042725 Aug 04 16:41:50.824786 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 572/1150] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:41:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:41:50.839378 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Going to try to terminate instance {{(pid=107559) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 16:41:50.935084 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1d00e857-2da8-4f2c-a292-4692ba25af2b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 204 len: 0 microversion: 2.1 time: 0.158802 Aug 04 16:41:50.936293 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 579/1151] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:41:50 2021] DELETE /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:50.947732 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:50.948942 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:50.955872 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:50.956377 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:50.957643 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:50.957839 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:51.235199 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.policy [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:51.249914 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-c54e1fce-7810-45bf-a46c-274aed4490b9 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1577 microversion: 2.1 time: 0.307276 Aug 04 16:41:51.250493 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 573/1152] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:50 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1577 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:52.269072 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:52.269654 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:52.276130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:52.276566 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:52.277320 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:52.277753 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:52.417130 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:52.424733 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-114bf8c2-2cf0-4a9f-8dec-a3db1061fa8d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1458 microversion: 2.1 time: 0.159903 Aug 04 16:41:52.425316 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 580/1153] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:52 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:53.326272 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [req-5a800266-4d38-4f8e-ac20-6f716ffa8835 req-4dfbb38b-ee02-48e3-83ca-d76bd4ca8f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1858d6-4e4d-4011-97bb-27f7ef6230b5", "name": "network-vif-deleted", "tag": "9df42b81-6500-4efa-88e9-1809026e2d87"}]} {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:53.328835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:41:53.328835 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: warnings.warn(msg) Aug 04 16:41:53.350953 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-5a800266-4d38-4f8e-ac20-6f716ffa8835 req-4dfbb38b-ee02-48e3-83ca-d76bd4ca8f41 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:53.351379 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [req-5a800266-4d38-4f8e-ac20-6f716ffa8835 req-4dfbb38b-ee02-48e3-83ca-d76bd4ca8f41 service nova] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:53.365666 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.compute.server_external_events [req-5a800266-4d38-4f8e-ac20-6f716ffa8835 req-4dfbb38b-ee02-48e3-83ca-d76bd4ca8f41 service nova] Creating event network-vif-deleted:9df42b81-6500-4efa-88e9-1809026e2d87 for instance cf1858d6-4e4d-4011-97bb-27f7ef6230b5 on hv-cinder-78956 Aug 04 16:41:53.369628 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0a3e30e-7a55-4740-a186-1b6a0cde96a2] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 57408. Aug 04 16:41:53.371386 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [req-5a800266-4d38-4f8e-ac20-6f716ffa8835 req-4dfbb38b-ee02-48e3-83ca-d76bd4ca8f41 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049845 Aug 04 16:41:53.372162 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 574/1154] 10.222.0.77 () {64 vars in 1318 bytes} [Wed Aug 4 16:41:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:41:53.442955 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:53.443706 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:53.450268 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:53.450865 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:53.451659 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:53.452813 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:53.528253 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.policy [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42938fd921404e889c0c61bd12416567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f80bf601104261bec5af98cd6a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:53.537461 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-d64dede7-2345-4667-b1a0-b041888ee21d tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 200 len: 1225 microversion: 2.1 time: 0.098674 Aug 04 16:41:53.538077 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 581/1155] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:53 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:41:54.555650 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:54.556457 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: cf1858d6-4e4d-4011-97bb-27f7ef6230b5] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:54.563439 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:54.563880 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:54.564985 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:54.565655 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:54.587395 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] HTTP exception thrown: Instance cf1858d6-4e4d-4011-97bb-27f7ef6230b5 could not be found. Aug 04 16:41:54.588203 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Returning 404 to user: Instance cf1858d6-4e4d-4011-97bb-27f7ef6230b5 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:41:54.589473 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-ba2690b0-0a11-422f-b9aa-842f376b7903 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5" status: 404 len: 111 microversion: 2.1 time: 0.038080 Aug 04 16:41:54.590342 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 575/1156] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:54 2021] GET /compute/v2.1/servers/cf1858d6-4e4d-4011-97bb-27f7ef6230b5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:55.393521 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:55.394364 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.compute.api [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107559) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:55.402144 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:55.402473 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:55.403273 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:55.403761 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG oslo_concurrency.lockutils [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:55.420178 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.wsgi [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] HTTP exception thrown: Instance dbec4d72-541d-4f20-a404-fb3a26c35f59 could not be found. Aug 04 16:41:55.420841 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Returning 404 to user: Instance dbec4d72-541d-4f20-a404-fb3a26c35f59 could not be found. {{(pid=107559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:41:55.421839 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-728e7def-5d0a-4a77-8eaa-1c026c230c51 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "DELETE /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 404 len: 111 microversion: 2.1 time: 0.032380 Aug 04 16:41:55.422635 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 582/1157] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 4 16:41:55 2021] DELETE /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:41:55.435563 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '>' {{(pid=107558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:55.436834 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.compute.api [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] [instance: dbec4d72-541d-4f20-a404-fb3a26c35f59] Fetching instance by UUID {{(pid=107558) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 16:41:55.449739 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:55.450696 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:55.452208 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 16:41:55.453010 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG oslo_concurrency.lockutils [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Lock "9260958d-5d7e-4ff1-bc72-6315537cc5be" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 16:41:55.483025 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.wsgi [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] HTTP exception thrown: Instance dbec4d72-541d-4f20-a404-fb3a26c35f59 could not be found. Aug 04 16:41:55.485384 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: DEBUG nova.api.openstack.wsgi [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Returning 404 to user: Instance dbec4d72-541d-4f20-a404-fb3a26c35f59 could not be found. {{(pid=107558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 16:41:55.486949 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO nova.api.openstack.requestlog [None req-2b7407e3-5d82-4af8-bb5e-25331a405b3b tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59" status: 404 len: 111 microversion: 2.1 time: 0.058873 Aug 04 16:41:55.487859 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: [pid: 107558|app: 0|req: 576/1158] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 4 16:41:55 2021] GET /compute/v2.1/servers/dbec4d72-541d-4f20-a404-fb3a26c35f59 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:56.910282 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: DEBUG nova.api.openstack.wsgi [None req-1df74441-1b47-4dbb-9ccb-68c14777bce3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] Calling method '.version_select at 0x7f27180829d0>' {{(pid=107559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:56.943510 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO nova.api.openstack.requestlog [None req-1df74441-1b47-4dbb-9ccb-68c14777bce3 tempest-TestVolumeBootPattern-1821532931 tempest-TestVolumeBootPattern-1821532931-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1339503199" status: 202 len: 0 microversion: 2.1 time: 0.037540 Aug 04 16:41:56.944687 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: [pid: 107559|app: 0|req: 583/1159] 10.222.0.77 () {58 vars in 1263 bytes} [Wed Aug 4 16:41:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1339503199 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:42:20.188309 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:42:20.189428 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:42:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:42:21.974434 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:42:21.975091 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: Wed Aug 4 16:42:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:44:17.145914 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:44:17.146803 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: Wed Aug 4 16:44:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:44:17.474834 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:44:17.474834 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:44:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:44:19.401784 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:44:19.402421 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: Wed Aug 4 16:44:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:44:24.624313 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:44:24.624948 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:44:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:45:40.207892 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:45:40.208634 dv-cinder-789564-9-iscsi devstack@n-api.service[107558]: Wed Aug 4 16:45:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:45:41.994272 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:45:41.994907 dv-cinder-789564-9-iscsi devstack@n-api.service[107559]: Wed Aug 4 16:45:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!